What are the hardware requirements for Huginn V5.10.7B?

Huginn V5.10.7B requires approximately 21.4 GB of VRAM and supports a context window of 32K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Huginn V5.10.7B and how large is it?

Huginn V5.10.7B is developed by The-Face-Of-Goonery, a model with 11b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Huginn V5.10.7B perform on standard benchmarks?

Huginn V5.10.7B has the following published scores: MMLU 54.22. Compare against reference models on this page or on the LLM Explorer leaderboards.

Huginn V5.10.7B by The-Face-Of-Goonery — VRAM 21.4GB, 32K context

Name: Huginn V5.10.7B
Author: The-Face-Of-Goonery

Huginn V5.10.7B is an open-source language model by The-Face-Of-Goonery. Features: 11b LLM, VRAM: 21.4GB, Context: 32K, License: cc-by-4.0, Quantized, LLM Explorer Score: 0.27, Arc: 63.3, HellaSwag: 78.8, MMLU: 54.2, GSM8K: 19.2.

Arxiv:2203.05482 Autotrain compatible Conversational Endpoints compatible Gguf License:cc-by-4.0 Merge Mergekit Mistral Q4 Quantized Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/The-Face-Of-Goonery/Huginn-V5-10.7B

Huginn V5.10.7B Parameters and Internals

LLM Name	Huginn V5.10.7B
Repository 🤗	https://huggingface.co/The-Face-Of-Goonery/Huginn-V5-10.7B
Model Size	11b
Required VRAM	21.4 GB
Updated	2024-07-04
Maintainer	The-Face-Of-Goonery
Model Type	mistral
Model Files	6.1 GB 9.9 GB: 1-of-3 9.8 GB: 2-of-3 1.7 GB: 3-of-3
GGUF Quantization	Yes
Quantization Type	q4\|gguf\|q4_k
Model Architecture	MistralForCausalLM
License	cc-by-4.0
Context Length	32768
Model Max Length	32768
Transformers Version	4.36.2
Tokenizer Class	LlamaTokenizer
Vocabulary Size	32000
Torch Data Type	float16

Rank the Huginn V5.10.7B capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Huginn V5.10.7B

Best Alternatives	Context / RAM	Downloads	Likes
Normistral 11B Warm	1000K / 22.9 GB	240	11
... 11B V2.2 Instruct EXL2 4.5bit	32K / 6.5 GB	391	3
...B V2.2 Instruct HQQ 8bit 128gs	32K / 11.7 GB	48	3
...B V2.2 Instruct HQQ 4bit 128gs	32K / 6.2 GB	43	3
...t 3.1 Frankenmerge 11B Gguf Q8	32K / 8.3 GB	65	1
Bielik 11B V2.2 Instruct GPTQ	32K / 6.2 GB	220	3
... 11B V2.2 Instruct Quanto 8bit	32K / 12 GB	209	4
Bielik 11B V2.2 Instruct W8A8	32K / 11.5 GB	172	3
Bielik 11B V2.2 Instruct AWQ	32K / 6.2 GB	85	3
Bielik 11B V2.2 Instruct FP8	32K / 11.4 GB	53	3