LLM EXPLORER 65,548 MODELS INDEXED

Accordion 6B A0.5B SFT by btzyd

By btzyd · 9 downloads

Accordion 6B A0.5B SFT is an open-source language model by btzyd. Features: 6b LLM, VRAM: 12.1GB, Context: 32K, License: other, LLM Explorer Score: 0.27.

  Adaptive-compute Base model:btzyd/accordion-6b-... Base model:finetune:btzyd/acco...   Conversational   Custom code   Elastic-depth   En   Layer-looping   Loop moe   Moe   Region:us   Safetensors

Accordion 6B A0.5B SFT Parameters and Internals

LLM NameAccordion 6B A0.5B SFT
Repository 🤗https://huggingface.co/btzyd/Accordion-6B-A0.5B-SFT 
Base Model(s)  btzyd/Accordion-6B-A0.5B-Base-32K   btzyd/Accordion-6B-A0.5B-Base-32K
Model Size6b
Required VRAM12.1 GB
Updated2026-10-25
Maintainerbtzyd
Model Typeloop_moe
Model Files  12.1 GB
Supported Languagesen
Model ArchitectureLoopMoEForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.57.1
Tokenizer ClassPreTrainedTokenizerFast
Beginning of Sentence Token<|begin▁of▁sentence|>
End of Sentence Token<|end▁of▁sentence|>
Vocabulary Size128000
Torch Data Typebfloat16

Best Alternatives to Accordion 6B A0.5B SFT

Best Alternatives
Context / RAM
Downloads
Likes
Accordion 6B A0.5B Base 32K32K / 12.1 GB100
Accordion 6B A0.5B Base 8K8K / 12.1 GB150
Note: green Score (e.g. "73.2") means that the model is better than btzyd/Accordion-6B-A0.5B-SFT.