Moistral 11B V2 is an open-source language model by TheDrummer. Features: 11b LLM, VRAM: 21.4GB, Context: 8K, License: cc-by-nc-4.0, LLM Explorer Score: 0.15, Arc: 45.1, HellaSwag: 71.9, MMLU: 39.
| LLM Name | Moistral 11B V2 |
| Repository 🤗 | https://huggingface.co/TheDrummer/Moistral-11B-v2 |
| Model Size | 11b |
| Required VRAM | 21.4 GB |
| Updated | 2024-09-25 |
| Maintainer | TheDrummer |
| Model Type | llama |
| Model Files | |
| Model Architecture | LlamaForCausalLM |
| License | cc-by-nc-4.0 |
| Context Length | 8192 |
| Model Max Length | 8192 |
| Transformers Version | 4.40.0.dev0 |
| Tokenizer Class | LlamaTokenizer |
| Padding Token | </s> |
| Vocabulary Size | 32000 |
| Torch Data Type | bfloat16 |
Model |
Likes |
Downloads |
VRAM |
|---|---|---|---|
| ...istral 11B V2 HQQ 4bit Smashed | 0 | 5 | 6 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| A6.1 | 1024K / 16.1 GB | 130 | 0 |
| ...k PL 11B V3.0 Instruct Heretic | 32K / 22.3 GB | 149 | 0 |
| MIstral 11B Omni OP U1k Ver0.1 | 32K / 21.4 GB | 11 | 0 |
| ...ral 11B Omni OP 1K 2048 Ver0.1 | 32K / 21.4 GB | 8 | 0 |
| Llama 3 Synatra 11B V1 20K | 20K / 23 GB | 4 | 9 |
| Fimbulvetr 11B V2.1 16K | 16K / 21.4 GB | 39 | 17 |
| Narumashi 11B V0.9 | 8K / 21.4 GB | 54 | 1 |
| Moistral 11B V5d E4 | 8K / 21.4 GB | 15 | 1 |
| Moistral 11B V3 | 8K / 21.4 GB | 67 | 108 |
| Moistral 11B V5c | 8K / 21.4 GB | 11 | 1 |