LLM EXPLORER 59,420 MODELS INDEXED

Llama 3 Merged Linear by wahid028

By wahid028 · 16 downloads

Llama 3 Merged Linear is an open-source language model by wahid028. Features: 8.2b LLM, VRAM: 5.8GB, Context: 8K, Merged, LLM Explorer Score: 0.12.

  Merged Model   Arxiv:1910.09700   4-bit   Bitsandbytes   Conversational   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Llama 3 Merged Linear Parameters and Internals

LLM NameLlama 3 Merged Linear
Repository πŸ€—https://huggingface.co/wahid028/llama-3-merged-linear 
Merged ModelYes
Model Size8.2b
Required VRAM5.8 GB
Updated2026-06-25
Maintainerwahid028
Model Typellama
Model Files  4.7 GB: 1-of-2   1.1 GB: 2-of-2
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.41.0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|eot_id|>
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Llama 3 Merged Linear

Best Alternatives
Context / RAM
Downloads
Likes
Ko Pt Model Test18K / 16.4 GB20270
Hola8K / 5.8 GB60
Llama SciQ 4bits8K / 5.8 GB120
...ma3 Quantized 5epochs 24 06 048K / 5.8 GB70
RAFT Llama3 Version 24.06.018K / 5.8 GB50
Llama 3 Ko Luxia Instruct8K / 16.4 GB63
KernelLLM Bnb 4bit128K / 5.7 GB91
KernelLLM Unsloth Bnb 4bit128K / 6 GB62
Llama3.1 Merged128K / 5.8 GB60
EPFL TA Meister 4bit8K / 5.8 GB60
Note: green Score (e.g. "73.2") means that the model is better than wahid028/llama-3-merged-linear.