LLM EXPLORER 61,060 MODELS INDEXED

HyLo Llama 6MLA22GDN 8K SFT by amd

By amd · 42 downloads

HyLo Llama 6MLA22GDN 8K SFT is an open-source language model by amd. Features: 3b LLM, VRAM: 17.1GB, Context: 128K, License: apache-2.0, Instruction-Based.

  Arxiv:2503.11132   Arxiv:2505.17272   Arxiv:2604.24715   Amd Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Conversational Dataset:junxiongwang/sftdatase... Dataset:nvidia/chatqa2-long-sf... Dataset:nvidia/openmathinstruc... Dataset:open-r1/openr1-math-22... Dataset:open-thoughts/openthou...   Distillation   En   Ext 8k   Gated-deltanet   Hybrid   Instruct   Kv-cache-compression   Llama   Long-context   Mla   Region:us   Safetensors

HyLo Llama 6MLA22GDN 8K SFT Parameters and Internals

LLM NameHyLo Llama 6MLA22GDN 8K SFT
Repository πŸ€—https://huggingface.co/amd/HyLo-Llama-6MLA22GDN-8K-SFT 
Base Model(s)  meta-llama/Llama-3.2-3B-Instruct   meta-llama/Llama-3.2-3B-Instruct
Model Size3b
Required VRAM17.1 GB
Updated2026-09-14
Maintaineramd
Model Typellama
Instruction-BasedYes
Model Files  17.1 GB
Supported Languagesen
Context Length8k
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.52.4
Tokenizer ClassPreTrainedTokenizer
Padding Token<|eot_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to HyLo Llama 6MLA22GDN 8K SFT

Best Alternatives
Context / RAM
Downloads
Likes
Llama 3.2 3B Instruct128K / 6.5 GB18295722368
Llama 3.2 3B Instruct128K / 6.5 GB18620796
...ama 3.2 3B TechWriter Instruct128K / 6.4 GB2260
Llama 3.2 3B Instruct128K / 6.5 GB9919
Llama3.2 3B Manumit V1128K / 6.4 GB1350
Alloma 3B Instruct128K / 6.5 GB554566
... V7 SFT 10voicebot Loopcleaned128K / 6.5 GB2290
Llama 3.2 3B RP Toxic Fuse128K / 6.4 GB142
DeepSeek R1 Distill Llama 3B128K / 6.5 GB24716
Schematron 3B128K / 6.5 GB969336
Note: green Score (e.g. "73.2") means that the model is better than amd/HyLo-Llama-6MLA22GDN-8K-SFT.