LLM EXPLORER 59,420 MODELS INDEXED

LongAlign 13B 64K AWQ by MaziyarPanahi

By MaziyarPanahi · 4 downloads

LongAlign 13B 64K AWQ is an open-source language model by MaziyarPanahi. Features: 13b LLM, VRAM: 7.2GB, Context: 64K, Quantized, LLM Explorer Score: 0.11.

  Arxiv:2401.18058   4-bit   Autotrain compatible   Awq Base model:quantized:zai-org/l... Base model:zai-org/longalign-1...   Dataset:thudm/longalign-10k   En   Endpoints compatible   Finetuned   Llama   Long context   Pytorch   Quantized   Region:us   Safetensors   Zh

LongAlign 13B 64K AWQ Parameters and Internals

Model Type 
text-generation
LLM NameLongAlign 13B 64K AWQ
Repository πŸ€—https://huggingface.co/MaziyarPanahi/LongAlign-13B-64k-AWQ 
Model NameLongAlign-13B-64k-AWQ
Model CreatorTHUDM
Base Model(s)  LongAlign 13B 64K   THUDM/LongAlign-13B-64k
Model Size13b
Required VRAM7.2 GB
Updated2026-08-03
MaintainerMaziyarPanahi
Model Typellama
Model Files  7.2 GB
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Context Length65536
Model Max Length65536
Transformers Version4.38.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32256
Torch Data Typefloat16

Best Alternatives to LongAlign 13B 64K AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Yarn Llama 2 13B 128K AWQ128K / 7.2 GB42
...oboros L2 13B 2 1 YaRN 64K AWQ64K / 7.2 GB52
OrcaMaid V3 13B 32K AWQ32K / 7.2 GB54
OrcaMaid V2 FIX 13B 32K AWQ32K / 7.2 GB71
NexusRaven V2 13B AWQ16K / 7.2 GB113
NexusRaven V2 13B AWQ16K / 7.2 GB13
...th CodeLlama 13B Python Hf AWQ16K / 7.5 GB60
WhiteRabbitNeo 13B AWQ16K / 7.2 GB3324
NexusRaven V2 13B AWQ16K / 7.2 GB101
Ramgpt 13B AWQ Gemm16K / 7.2 GB01
Note: green Score (e.g. "73.2") means that the model is better than MaziyarPanahi/LongAlign-13B-64k-AWQ.