LLM EXPLORER 65,418 MODELS INDEXED

HuginnV5.5 12.6B by The-Face-Of-Goonery

By The-Face-Of-Goonery · 0 downloads
HF Repo ↗ Copy URL

HuginnV5.5 12.6B is an open-source language model by The-Face-Of-Goonery. Features: 12.6b LLM, VRAM: 25.8GB, Context: 32K, License: cc-by-4.0, Quantized, LLM Explorer Score: 0.26, Arc: 72, HellaSwag: 86.7, MMLU: 64.5, GSM8K: 62.6.

  Autotrain compatible   Conversational   Endpoints compatible   Gguf   License:cc-by-4.0   Mistral   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/The-Face-Of-Goonery/HuginnV5.5-12.6B 

HuginnV5.5 12.6B Parameters and Internals

LLM NameHuginnV5.5 12.6B
Repository 🤗https://huggingface.co/The-Face-Of-Goonery/HuginnV5.5-12.6B 
Model Size12.6b
Required VRAM25.8 GB
Updated2024-07-04
MaintainerThe-Face-Of-Goonery
Model Typemistral
Model Files  7.3 GB   3.2 GB   7.3 GB   9.9 GB: 1-of-3   9.9 GB: 2-of-3   6.0 GB: 3-of-3
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureMistralForCausalLM
Licensecc-by-4.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to HuginnV5.5 12.6B

Best Alternatives
Context / RAM
Downloads
Likes
...al Nemo Instruct 2407 Bnb 4bit128K / 8.3 GB727731
...istral Nemo Base 2407 Bnb 4bit128K / 8.3 GB189815
...uginnV5.5 12.6B 8.0bpw H8 EXL232K / 13.1 GB31