LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Llama 13B 3bit Gr128 by 4bit

 »  All LLMs  »  4bit  »  Llama 13B 3bit Gr128   URL Share it on

  12   
  3bit   Autotrain compatible   Endpoints compatible   Llama   Quantized   Region:us
Model Card on HF 🤗: https://huggingface.co/4bit/llama-13b-3bit-gr128 

Llama 13B 3bit Gr128 Benchmarks

LLME Score: 0.07606
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Llama 13B 3bit Gr128 (4bit/llama-13b-3bit-gr128)
🌟 Advertise your project 🚀

Llama 13B 3bit Gr128 Parameters and Internals

Additional Notes 
The model was generated using specific settings: --wbits 4 --groupsize 128 --true-sequential --new-eval --faster-kernel.
LLM NameLlama 13B 3bit Gr128
Repository 🤗https://huggingface.co/4bit/llama-13b-3bit-gr128 
Model Size13b
Required VRAM5.9 GB
Updated2025-09-23
Maintainer4bit
Model Typellama
Model Files  5.9 GB
Quantization Type3bit
Model ArchitectureLLaMAForCausalLM
Transformers Version4.27.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Llama 13B 3bit Gr128

Best Alternatives
Context / RAM
Downloads
Likes
... X Alpaca 13B Native 4bit 128g0K / 7.9 GB1006734
... X Alpaca 13B Native 4bit 128g0K / 8.1 GB62
Llama 13B 4bit Hf0K / 7 GB122
Llama 13B 4bit Gr1280K / 7.5 GB122
... X Alpaca 13B Native 4bit 128g0K / 7.9 GB73
Llama 13B 4bit Gr1280K / 7.5 GB155
Llama 13B 3bit Gr1280K / 5.9 GB153
Llm Jp 13B V2.04K / 27.4 GB52315
Swallow 13B GPTQ4K / 7.5 GB60
Decapoda Research Llama 13B0K / 41 GB50
Note: green Score (e.g. "73.2") means that the model is better than 4bit/llama-13b-3bit-gr128.

Rank the Llama 13B 3bit Gr128 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51549 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer