LLM EXPLORER 66,704 MODELS INDEXED

HyLo Llama 6MLA22GDN 8K SFT by amd

By amd · 42 downloads

HyLo Llama 6MLA22GDN 8K SFT is an open-source language model by amd. Features: 3b LLM, VRAM: 17.1GB, Context: 128K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.25.

  Arxiv:2503.11132   Arxiv:2505.17272   Arxiv:2604.24715   Amd Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Conversational Dataset:junxiongwang/sftdatase... Dataset:nvidia/chatqa2-long-sf... Dataset:nvidia/openmathinstruc... Dataset:open-r1/openr1-math-22... Dataset:open-thoughts/openthou...   Distillation   En   Ext 8k   Gated-deltanet   Hybrid   Instruct   Kv-cache-compression   Llama   Long-context   Mla   Region:us   Safetensors

HyLo Llama 6MLA22GDN 8K SFT Parameters and Internals

LLM NameHyLo Llama 6MLA22GDN 8K SFT
Repository πŸ€—https://huggingface.co/amd/HyLo-Llama-6MLA22GDN-8K-SFT 
Base Model(s)  meta-llama/Llama-3.2-3B-Instruct   meta-llama/Llama-3.2-3B-Instruct
Model Size3b
Required VRAM17.1 GB
Updated2026-09-14
Maintaineramd
Model Typellama
Instruction-BasedYes
Model Files  17.1 GB
Supported Languagesen
Context Length8k
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.52.4
Tokenizer ClassPreTrainedTokenizer
Padding Token<|eot_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to HyLo Llama 6MLA22GDN 8K SFT

Best Alternatives
Context / RAM
Downloads
Likes
Llama 3.2 3B Instruct128K / 6.5 GB18295722368
Llama 3.2 3B Instruct128K / 6.5 GB18620796
Llama 3.2 3B ClauseLM128K / 6.4 GB3352
...ld Llama32 3B Instruct Qa 1p25128K / 6.5 GB3401
...old Llama32 3B Instruct Qa 2p5128K / 6.5 GB3341
...lama 3.2 3B ORPO Advertisement128K / 6.5 GB1892
...3B TechWriter Instruct Unsloth128K / 6.5 GB6271
...ini Math345 GroupB Llama32 End128K / 6.5 GB7550
Llama 3.2 3B Instruct128K / 6.5 GB9919
...ama 3.2 3B TechWriter Instruct128K / 6.4 GB2260
Note: green Score (e.g. "73.2") means that the model is better than amd/HyLo-Llama-6MLA22GDN-8K-SFT.