Aquila2 34B is an open-source language model by BAAI. Features: 34b LLM, VRAM: 136.4GB, Context: 8K, License: other, HF Score: 54.5, LLM Explorer Score: 0.14, Arc: 52.7, HellaSwag: 82, MMLU: 76, TruthfulQA: 40.8, WinoGrande: 75.1, GSM8K: 0.5.
| Model Type |
| |||||||
| Additional Notes |
| |||||||
| Release Notes |
|
| LLM Name | Aquila2 34B |
| Repository ๐ค | https://huggingface.co/BAAI/Aquila2-34B |
| Model Size | 34b |
| Required VRAM | 136.4 GB |
| Updated | 2026-03-17 |
| Maintainer | BAAI |
| Model Type | aquila |
| Model Files | |
| Model Architecture | AquilaForCausalLM |
| License | other |
| Context Length | 8192 |
| Model Max Length | 8192 |
| Transformers Version | 4.42.3 |
| Tokenizer Class | PreTrainedTokenizerFast |
| Padding Token | <|end_of_text|> |
| Vocabulary Size | 143973 |
| Torch Data Type | float32 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| AquilaChat2 34B 16K | 16K / 67.2 GB | 226 | 24 |
| AquilaChat2 34B | 4K / 67.2 GB | 378 | 46 |
| H2ogpt 16K Aquilachat2 34B | 4K / 67.2 GB | 35 | 4 |
| AquilaChat2 34B 16K GPTQ | 4K / 18.7 GB | 13 | 5 |
| AquilaChat2 34B 16K AWQ | 4K / 19.3 GB | 6 | 3 |
| AquilaChat2 34B GPTQ | 4K / 18.7 GB | 6 | 2 |
| AquilaChat2 34B AWQ | 4K / 19.3 GB | 10 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐