LLM EXPLORER 59,358 MODELS INDEXED

Pruned40 Llama 1B by oopere

By oopere · 42 downloads

Pruned40 Llama 1B is an open-source language model by oopere. Features: 1b LLM, VRAM: 1.8GB, Context: 128K, License: llama3.2, LLM Explorer Score: 0.17.

  Autotrain compatible Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Endpoints compatible   Llama   Region:us   Safetensors

Pruned40 Llama 1B Parameters and Internals

LLM NamePruned40 Llama 1B
Repository πŸ€—https://huggingface.co/oopere/pruned40-llama-1b 
Base Model(s)  meta-llama/Llama-3.2-1B   meta-llama/Llama-3.2-1B
Model Size1b
Required VRAM1.8 GB
Updated2024-12-22
Maintaineroopere
Model Typellama
Model Files  1.8 GB
Model ArchitectureLlamaForCausalLM
Licensellama3.2
Context Length131072
Model Max Length131072
Transformers Version4.46.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Pruned40 Llama 1B

Best Alternatives
Context / RAM
Downloads
Likes
ISA 02 Nano Llama 3.2 1B1024K / 2.5 GB473
LWM Text 1M1024K / 13.5 GB114929
LWM Text Chat 1M1024K / 13.5 GB57173
JOSIE 1M Base1024K / 13.5 GB121
JOSIE 1M Base1024K / 13.5 GB61
MiniCPM5 1B MegaMerge Final512K / 2.2 GB01
MiniCPM5 1B128K / 2.2 GB354385868
Llama 3.2 1B Instruct128K / 2.5 GB212072100
...1B Claude Opus Fable5 Thinking128K / 2.2 GB6165166
Llama 3.2 1B Instruct128K / 2.5 GB101146341549
Note: green Score (e.g. "73.2") means that the model is better than oopere/pruned40-llama-1b.