LLM EXPLORER 60,783 MODELS INDEXED

QuartetAnemoi 70B T0.0001 AWQ by tachyphylaxis

By tachyphylaxis · 3 downloads

QuartetAnemoi 70B T0.0001 AWQ is an open-source language model by tachyphylaxis. Features: 70b LLM, VRAM: 36.7GB, Context: 31K, Quantized, LLM Explorer Score: 0.11, Arc: 73.4, HellaSwag: 88.9, MMLU: 75.4, GSM8K: 68.6.

  4-bit   Awq   Endpoints compatible   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

QuartetAnemoi 70B T0.0001 AWQ Parameters and Internals

LLM NameQuartetAnemoi 70B T0.0001 AWQ
Repository πŸ€—https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ 
Base Model(s)  alchemonaut/QuartetAnemoi-70B-t0.0001   alchemonaut/QuartetAnemoi-70B-t0.0001
Model Size70b
Required VRAM36.7 GB
Updated2026-08-03
Maintainertachyphylaxis
Model Typellama
Model Files  5.0 GB: 1-of-8   5.0 GB: 2-of-8   4.9 GB: 3-of-8   4.9 GB: 4-of-8   4.9 GB: 5-of-8   4.9 GB: 6-of-8   4.9 GB: 7-of-8   2.2 GB: 8-of-8
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Context Length32764
Model Max Length32764
Transformers Version4.37.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to QuartetAnemoi 70B T0.0001 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
...0B Instruct Gradient 1048K AWQ1024K / 39.9 GB51
...70B Instruct Gradient 262K AWQ256K / 39.9 GB50
Llama 3.3 70B Instruct AWQ128K / 39.9 GB26200246
...lama 3.3 70B Instruct AWQ INT4128K / 39.9 GB8274430
Llama 3.3 70B Instruct AWQ128K / 39.9 GB1609012
... SauerkrautLM 70B Instruct AWQ128K / 39.9 GB55
MultiVerse 70B AWQ32K / 41.3 GB702
Opus V1.2 70B AWQ32K / 36.7 GB91
Senku 70B AWQ 4bit GEMM31K / 36.7 GB21
Kiqu 70B AWQ31K / 36.7 GB11
Note: green Score (e.g. "73.2") means that the model is better than tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ.