LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Alpaca 30B Int4 by MetaIX

 »  All LLMs  »  MetaIX  »  Alpaca 30B Int4   URL Share it on

  70   
  Autotrain compatible   Endpoints compatible   Llama   Pytorch   Region:us
Model Card on HF 🤗: https://huggingface.co/MetaIX/Alpaca-30B-Int4 

Alpaca 30B Int4 Benchmarks

ARC: 79.4 vs 96.7 (so35)-17.9%
HellaSwag: 80.5 vs 95.3 (gpt4)-15.5%
MMLU: 58.7 vs 88.3 (so35)-33.5%
GSM8K: 42.3 vs 96.4 (so35)-56.1%
OpenCompas: 52.2 vs 73.3 (gpt4)-28.8%
Exam: 59.8 vs 77.2 (gpt4)-22.5%
Language: 39.8 vs 62 (gpt4)-35.8%
Knowledge: 64 vs 73.5 (gpt4)-12.9%
Understand: 57.1 vs 70 (gpt4)-18.4%
Reasoning: 48.5 vs 74.4 (gpt4)-34.8%
LLME Score: 0.07732
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Alpaca 30B Int4 (MetaIX/Alpaca-30B-Int4)
🌟 Advertise your project 🚀

Alpaca 30B Int4 Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Text generation
Additional Notes 
Quantized using --true-sequential and --act-order
Training Details 
Data Sources:
Clean Alpaca Dataset
Methodology:
Quantized with GPTQ using --true-sequential and --act-order
Release Notes 
Version:
unknown
Date:
04.06.2023
Notes:
Updated using the clean alpaca dataset with refined training parameters
LLM NameAlpaca 30B Int4
Repository 🤗https://huggingface.co/MetaIX/Alpaca-30B-Int4 
Model Size30b
Required VRAM16.9 GB
Updated2025-09-15
MaintainerMetaIX
Model Typellama
Model Files  16.9 GB
Model ArchitectureLlamaForCausalLM
Transformers Version4.28.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Quantized Models of the Alpaca 30B Int4

Model
Likes
Downloads
VRAM
Alpaca 30B Lora Int468916 GB

Best Alternatives to Alpaca 30B Int4

Best Alternatives
Context / RAM
Downloads
Likes
TildeOpen 30B64K / 60.9 GB268279
Flash Llama 30M 2000132K / 0.1 GB18080
Smaug Slerp 30B V0.132K / 60.4 GB50
Tenebra 30B Alpha0116K / 65 GB1112
Llama33b 16K16K / 65.2 GB51
Yayi2 30B Llama4K / 121.2 GB92222
... Tokens By Perplexity Bottom K4K / 5.4 GB50
...lue Sample With Temperature2.04K / 5.4 GB60
... Tokens By Writing Style Top K4K / 5.4 GB60
...via Sample With Temperature2.04K / 5.4 GB50
Note: green Score (e.g. "73.2") means that the model is better than MetaIX/Alpaca-30B-Int4.

Rank the Alpaca 30B Int4 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51369 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer