LLM EXPLORER 65,548 MODELS INDEXED

Accordion 6B A0.5B Base 32K by btzyd

By btzyd · 10 downloads

Accordion 6B A0.5B Base 32K is an open-source language model by btzyd. Features: 6b LLM, VRAM: 12.1GB, Context: 32K, License: other, LLM Explorer Score: 0.27.

  Adaptive-compute Base model:btzyd/accordion-6b-... Base model:finetune:btzyd/acco...   Custom code   Elastic-depth   En   Ext 8k   Layer-looping   Loop moe   Moe   Region:us   Safetensors

Accordion 6B A0.5B Base 32K Parameters and Internals

LLM NameAccordion 6B A0.5B Base 32K
Repository 🤗https://huggingface.co/btzyd/Accordion-6B-A0.5B-Base-32K 
Base Model(s)  btzyd/Accordion-6B-A0.5B-Base-8K   btzyd/Accordion-6B-A0.5B-Base-8K
Model Size6b
Required VRAM12.1 GB
Updated2026-10-25
Maintainerbtzyd
Model Typeloop_moe
Model Files  12.1 GB
Supported Languagesen
Context Length8k
Model ArchitectureLoopMoEForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.57.1
Tokenizer ClassPreTrainedTokenizerFast
Beginning of Sentence Token<|begin▁of▁sentence|>
End of Sentence Token<|end▁of▁sentence|>
Vocabulary Size128000
Torch Data Typebfloat16

Best Alternatives to Accordion 6B A0.5B Base 32K

Best Alternatives
Context / RAM
Downloads
Likes
Accordion 6B A0.5B SFT32K / 12.1 GB90
Accordion 6B A0.5B Base 8K8K / 12.1 GB150
Note: green Score (e.g. "73.2") means that the model is better than btzyd/Accordion-6B-A0.5B-Base-32K.