LLM EXPLORER 64,924 MODELS INDEXED

Sheared Llama 2.7B Deita 6K Sft by Spico

By Spico · 4 downloads

Sheared Llama 2.7B Deita 6K Sft is an open-source language model by Spico. Features: 2.7b LLM, VRAM: 5.4GB, Context: 4K, LLM Explorer Score: 0.11.

  Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Sheared Llama 2.7B Deita 6K Sft Parameters and Internals

Model Type 
text generation
Additional Notes 
This model is for fair comparison with LLaMA-MoE-v1-sft.
Training Details 
Data Sources:
Deita-6K
Methodology:
supervised fine-tuning
LLM NameSheared Llama 2.7B Deita 6K Sft
Repository πŸ€—https://huggingface.co/Spico/sheared-llama-2.7b-deita-6k-sft 
Model Size2.7b
Required VRAM5.4 GB
Updated2026-08-02
MaintainerSpico
Model Typellama
Model Files  5.0 GB: 1-of-2   0.4 GB: 2-of-2
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Sheared Llama 2.7B Deita 6K Sft

Best Alternatives
Context / RAM
Downloads
Likes
Sheared LLaMA 2.7B4K / 10.8 GB82161
Dopeyshearedplats 2.7B V14K / 5.7 GB2142
...redplats 2.7B V2 Instruct V0.14K / 5.4 GB53
Shearedplats 2.7B V24K / 5.7 GB2262
Llama Final4K / 5.5 GB50
DPO VinaLlama Completed4K / 5.6 GB80
Urllm Ko En 2.7B4K / 11.2 GB50
Sheared LLaMA 2.7B Weblinx4K / 5.4 GB232
Sheared LLaMA 2.7B Pruned4K / 5.4 GB213
Vinallama 2.7B Chat4K / 5.5 GB37016
Note: green Score (e.g. "73.2") means that the model is better than Spico/sheared-llama-2.7b-deita-6k-sft.