LLM EXPLORER 67,952 MODELS INDEXED

Wizard Mega 13B GPTQ by TheBloke

By TheBloke · 54 downloads

Wizard Mega 13B GPTQ is an open-source language model by TheBloke. Features: 13b LLM, VRAM: 7.5GB, Context: 2K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.11, Arc: 27.7, HellaSwag: 26, MMLU: 25, GSM8K: 9.

  4-bit Base model:openaccess-ai-colle... Base model:quantized:openacces... Dataset:anon8231489123/sharegp... Dataset:ehartford/wizard vicun... Dataset:ehartford/wizardlm alp...   En   Gptq   Instruct   Llama   Quantized   Region:us   Safetensors

Wizard Mega 13B GPTQ Parameters and Internals

Model Type 
llama
Additional Notes 
Wizard Mega 13B has not been aligned to human preferences with techniques like RLHF or deployed with in-the-loop filtering, so it can produce problematic outputs if prompted.
Training Details 
Data Sources:
anon8231489123/ShareGPT_Vicuna_unfiltered, ehartford/wizard_vicuna_70k_unfiltered, ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered
Methodology:
Fine-tuning
Training Time:
15 hours
Hardware Used:
8xA100 80GB
Input Output 
Input Format:
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:
LLM NameWizard Mega 13B GPTQ
Repository πŸ€—https://huggingface.co/TheBloke/wizard-mega-13B-GPTQ 
Model NameWizard Mega 13B
Model CreatorOpen Access AI Collective
Base Model(s)  Wizard Mega 13B   openaccess-ai-collective/wizard-mega-13b
Model Size13b
Required VRAM7.5 GB
Updated2026-07-30
MaintainerTheBloke
Model Typellama
Instruction-BasedYes
Model Files  7.5 GB
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length2048
Model Max Length2048
Transformers Version4.29.1
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Wizard Mega 13B GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
NexusRaven 13B GPTQ16K / 7.3 GB357
CodeLlama 13B Instruct GPTQ16K / 7.3 GB7539
Leo Hessianai 13B Chat GPTQ8K / 7.3 GB471
...sianai 13B Chat Bilingual GPTQ8K / 7.3 GB24
...lama2 13B Orca V2 8K 3166 GPTQ8K / 7.3 GB4824
Mythalion 13B GPTQ4K / 7.3 GB200552
Swallow 13B Instruct GPTQ4K / 7.5 GB62
...2 13B Ft Instruct Es Gptq 3bit4K / 5.7 GB63
Pygmalion 2 13B GPTQ4K / 7.3 GB3541
LoKuS 13B GPTQ4K / 7.3 GB712