LLM EXPLORER 59,358 MODELS INDEXED

Llama 3.2 1B AllDataSources 5e 05 Constant 512 Flattening by Mattia2700

By Mattia2700 · 12 downloads

Llama 3.2 1B AllDataSources 5e 05 Constant 512 Flattening is an open-source language model by Mattia2700. Features: 1b LLM, VRAM: 2.5GB, Context: 128K, LLM Explorer Score: 0.17.

  Arxiv:1910.09700   Endpoints compatible   Llama   Region:us   Safetensors

Llama 3.2 1B AllDataSources 5e 05 Constant 512 Flattening Parameters and Internals

LLM NameLlama 3.2 1B AllDataSources 5e 05 Constant 512 Flattening
Repository πŸ€—https://huggingface.co/Mattia2700/Llama-3.2-1B_AllDataSources_5e-05_constant_512_flattening 
Model Size1b
Required VRAM2.5 GB
Updated2026-07-21
MaintainerMattia2700
Model Typellama
Model Files  2.5 GB   0.0 GB
Model ArchitectureLlamaForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.45.0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<pad>
Vocabulary Size128257
Torch Data Typebfloat16

Best Alternatives to Llama 3.2 1B AllDataSources 5e 05 Constant 512 Flattening

Best Alternatives
Context / RAM
Downloads
Likes
ISA 02 Nano Llama 3.2 1B1024K / 2.5 GB473
LWM Text 1M1024K / 13.5 GB114929
LWM Text Chat 1M1024K / 13.5 GB57173
JOSIE 1M Base1024K / 13.5 GB121
JOSIE 1M Base1024K / 13.5 GB61
MiniCPM5 1B MegaMerge Final512K / 2.2 GB01
MiniCPM5 1B128K / 2.2 GB354385868
Llama 3.2 1B Instruct128K / 2.5 GB212072100
...1B Claude Opus Fable5 Thinking128K / 2.2 GB6165166
Llama 3.2 1B Instruct128K / 2.5 GB101146341549
Note: green Score (e.g. "73.2") means that the model is better than Mattia2700/Llama-3.2-1B_AllDataSources_5e-05_constant_512_flattening.