Llama 3 Experiment V1 9B GGUF by grimjim

 »  All LLMs  »  grimjim  »  Llama 3 Experiment V1 9B GGUF   URL Share it on

Llama 3 Experiment V1 9B GGUF is an open-source language model by grimjim. Features: 9b LLM, VRAM: 5.4GB, Context: 8K, License: llama3, Quantized, Instruction-Based, LLM Explorer Score: 0.14.

Base model:grimjim/llama-3-exp... Base model:quantized:grimjim/l...   Conversational   En   Endpoints compatible   Gguf   Instruct   Llama   Llama-3   Meta   Pytorch   Quantized   Region:us

Llama 3 Experiment V1 9B GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Llama 3 Experiment V1 9B GGUF Parameters and Internals

Model Type 
text-generation
Additional Notes 
This is an experimental merge with damage tolerable as is, affecting narrative text completion.
Supported Languages 
en (Proficient)
Training Details 
Methodology:
passthrough merge method
Model Architecture:
Replication of additional layers without post-merge healing
LLM NameLlama 3 Experiment V1 9B GGUF
Repository 🤗https://huggingface.co/grimjim/llama-3-experiment-v1-9B-GGUF 
Base Model(s)  Llama 3 Experiment V1 9B   grimjim/llama-3-experiment-v1-9B
Model Size9b
Required VRAM5.4 GB
Updated2026-05-04
Maintainergrimjim
Model Typellama
Instruction-BasedYes
Model Files  6.3 GB   7.3 GB   9.5 GB   5.4 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.40.1
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to Llama 3 Experiment V1 9B GGUF

Best Alternatives
Context / RAM
Downloads
Likes
SekhmetX 9B V0.1 Test256K / 21.2 GB712
SekmetX 9B V0.1 Test256K / 21.2 GB692
Mike Hawk 9B256K / 21.3 GB33
Xgen Small 9B Instruct R256K / 42.5 GB4111
Yi Coder 9B Chat Instruct TIES128K / 17.7 GB50
EuroLLM 9B Instruct 251232K / 18.3 GB58988
EVA Yi 1.5 9B 32K V132K / 17.7 GB715
...ity Instruct 3M 0625 Yi 1.5 9B4K / 17.7 GB82784
ChinaLM 9B4K / 17.9 GB131
Note: green Score (e.g. "73.2") means that the model is better than grimjim/llama-3-experiment-v1-9B-GGUF.

Rank the Llama 3 Experiment V1 9B GGUF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53999 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a