LLM EXPLORER 59,420 MODELS INDEXED

YamshadowExperiment28 7B by automerger

By automerger · 7871 downloads

YamshadowExperiment28 7B is an open-source language model by automerger. Features: 7b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, Merged, LLM Explorer Score: 0.21, Arc: 73.3, HellaSwag: 89.3, MMLU: 64.4, GSM8K: 70.5.

  Merged Model Base model:yam-peleg/experimen...   Endpoints compatible   Mistral   Region:us   Safetensors   Sharded   Tensorflow

YamshadowExperiment28 7B Parameters and Internals

Model Type 
text generation
Use Cases 
Applications:
research, commercial applications
Primary Use Cases:
chat-based applications
Limitations:
Overfitting to specific benchmarks.
Additional Notes 
The model's excellent results on benchmark tests may be indicative of overfitting.
Training Details 
Methodology:
Merge technique: SLERP between layers of two models
Context Length:
8000
Input Output 
Input Format:
Alpaca chat template
Accepted Modalities:
text
Output Format:
text
Performance Tips:
The model can sometimes break and output a lot of "INST."
LLM NameYamshadowExperiment28 7B
Repository πŸ€—https://huggingface.co/automerger/YamshadowExperiment28-7B 
Base Model(s)  YamShadow 7B   Experiment28 7B   automerger/YamShadow-7B   yam-peleg/Experiment28-7B
Merged ModelYes
Model Size7b
Required VRAM14.4 GB
Updated2026-08-02
Maintainerautomerger
Model Typemistral
Model Files  9.9 GB: 1-of-2   4.5 GB: 2-of-2
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Quantized Models of the YamshadowExperiment28 7B

Model
Likes
Downloads
VRAM
YamshadowExperiment28 7B GGUF03012 GB

Best Alternatives to YamshadowExperiment28 7B

Best Alternatives
Context / RAM
Downloads
Likes
...Nemo Instruct 2407 Abliterated1000K / 24.5 GB22020
MegaBeam Mistral 7B 512K512K / 14.4 GB847054
SpydazWeb AI HumanAI RP512K / 14.4 GB161
SpydazWeb AI HumanAI 002512K / 14.4 GB181
...daz Web AI ChatML 512K Project512K / 14.5 GB120
MegaBeam Mistral 7B 300K282K / 14.4 GB377916
MegaBeam Mistral 7B 300K282K / 14.4 GB801817
Hebrew Mistral 7B 200K256K / 30 GB2315
Astral 256K 7B250K / 14.4 GB90
Astral 256K 7B V2250K / 14.4 GB80
Note: green Score (e.g. "73.2") means that the model is better than automerger/YamshadowExperiment28-7B.