LLM EXPLORER 65,548 MODELS INDEXED

Accordion 6B A0.5B Base 8K by btzyd

By btzyd · 15 downloads

Accordion 6B A0.5B Base 8K is an open-source language model by btzyd. Features: 6b LLM, VRAM: 12.1GB, Context: 8K, License: other, LLM Explorer Score: 0.27.

  Adaptive-compute   Custom code   Elastic-depth   En   Ext 8k   Layer-looping   Loop moe   Moe   Region:us   Safetensors

Accordion 6B A0.5B Base 8K Parameters and Internals

LLM NameAccordion 6B A0.5B Base 8K
Repository 🤗https://huggingface.co/btzyd/Accordion-6B-A0.5B-Base-8K 
Model Size6b
Required VRAM12.1 GB
Updated2026-10-25
Maintainerbtzyd
Model Typeloop_moe
Model Files  12.1 GB
Supported Languagesen
Context Length8k
Model ArchitectureLoopMoEForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.57.1
Tokenizer ClassPreTrainedTokenizerFast
Beginning of Sentence Token<|begin▁of▁sentence|>
End of Sentence Token<|end▁of▁sentence|>
Vocabulary Size128000
Torch Data Typebfloat16

Best Alternatives to Accordion 6B A0.5B Base 8K

Best Alternatives
Context / RAM
Downloads
Likes
Accordion 6B A0.5B Base 32K32K / 12.1 GB100
Accordion 6B A0.5B SFT32K / 12.1 GB90