LLM EXPLORER 57,918 MODELS INDEXED

Webtext 8K Micro 250801 by minpeter

By minpeter · 9 downloads

Webtext 8K Micro 250801 is an open-source language model by minpeter. Features: 20m LLM, Context: 8K, LLM Explorer Score: 0.19.

  Arxiv:1910.09700   Endpoints compatible   Ext 8k   Llama   Region:us   Safetensors

Webtext 8K Micro 250801 Parameters and Internals

LLM NameWebtext 8K Micro 250801
Repository πŸ€—https://huggingface.co/minpeter/webtext-8k-micro-250801 
Model Size20m
Required VRAM0 GB
Updated2026-07-29
Maintainerminpeter
Model Typellama
Model Files  0.0 GB   0.0 GB
Context Length8k
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.54.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|endoftext|>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Webtext 8K Micro 250801

Best Alternatives
Context / RAM
Downloads
Likes
Internlm2 5 20B Llamafied256K / 39.9 GB75
EAGLE3 GPT Oss 20B128K / 0.7 GB5070
Stellaris Internlm2 20B R51232K / 39.8 GB123
Internlm2 Chat 20B Llama Old32K / 39.6 GB83
Internlm2 Base 20B Llama32K / 39.6 GB63
Internlm2 Base 20B Llama32K / 39.6 GB60
Deita 20B32K / 39.8 GB631
Internlm2 20B Llama32K / 39.6 GB8120
Bagel 20B V04 Llama32K / 39.6 GB67
Bagel DPO 20B V04 Llama32K / 39.6 GB73
Note: green Score (e.g. "73.2") means that the model is better than minpeter/webtext-8k-micro-250801.