LLM EXPLORER 59,358 MODELS INDEXED

Llama 3 15B Instruct Zeroed Ft by elinas

By elinas · 19 downloads

Llama 3 15B Instruct Zeroed Ft is an open-source language model by elinas. Features: 15b LLM, VRAM: 30.1GB, Context: 8K, License: llama3, Instruction-Based, LLM Explorer Score: 0.14, Arc: 60.8, HellaSwag: 78.9, MMLU: 67.7, GSM8K: 71.6.

Base model:elinas/llama-3-15b-... Base model:finetune:elinas/lla...   Conversational Dataset:chat-error/pure-dove-s...   Endpoints compatible   Instruct   Llama   Merge   Mergekit   Region:us   Safetensors   Sharded   Tensorflow

Llama 3 15B Instruct Zeroed Ft Parameters and Internals

Model Type 
text generation, language model
Additional Notes 
Experiment aimed at stabilizing the model post fine-tuning with potential for continued fine-tuning.
Training Details 
Data Sources:
Chat-Error/Pure-dove-sharegpt
Methodology:
QLoRA finetuning on a zeroed passthrough merge of pre-trained language models.
Context Length:
8192
Training Time:
2h 30m
Hardware Used:
3x3090 GPUs
LLM NameLlama 3 15B Instruct Zeroed Ft
Repository πŸ€—https://huggingface.co/elinas/Llama-3-15B-Instruct-zeroed-ft 
Base Model(s)  Llama 3 15B Instruct Zeroed   elinas/Llama-3-15B-Instruct-zeroed
Model Size15b
Required VRAM30.1 GB
Updated2026-07-25
Maintainerelinas
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-7   5.0 GB: 2-of-7   4.9 GB: 3-of-7   5.0 GB: 4-of-7   4.9 GB: 5-of-7   4.2 GB: 6-of-7   1.1 GB: 7-of-7
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.40.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to Llama 3 15B Instruct Zeroed Ft

Best Alternatives
Context / RAM
Downloads
Likes
Hamanasu 15B Instruct16K / 29.4 GB4739
L3 Aethora 15B V28K / 30.1 GB2242
Meta Llama 3 15B Instruct8K / 23.9 GB31
OpenCrystal 15B L3 V38K / 30 GB1310
OpenCrystal L3 15B V2.18K / 30 GB35
OpenCrystal 15B L3 V28K / 30 GB36
Llama 3 15B Instruct Ft V28K / 30.1 GB134
L3 Aethora 15B V28K / 30.1 GB2944
LLaMa 3 Stheno V3.2 15B8K / 30 GB175
L3 NA Aethora 15B8K / 30.1 GB73
Note: green Score (e.g. "73.2") means that the model is better than elinas/Llama-3-15B-Instruct-zeroed-ft.