LLM EXPLORER 61,491 MODELS INDEXED

Smaug 34B V0.1 GPTQ by LoneStriker

By LoneStriker · 1 downloads
HF Repo ↗ Copy URL

Smaug 34B V0.1 GPTQ is an open-source language model by LoneStriker. Features: 34b LLM, VRAM: 21.2GB, Context: 195K, License: other, Quantized, LLM Explorer Score: 0.11.

  4bit Base model:finetune:jondurbin/... Base model:jondurbin/bagel-34b...   Conversational   Endpoints compatible   Gptq   Llama   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/LoneStriker/Smaug-34B-v0.1-GPTQ 

Smaug 34B V0.1 GPTQ Parameters and Internals

Additional Notes 
This model is a finetune of jondurbin's bagel model, trained with new datasets and a new technique to be shared soon. There is no merging.
LLM NameSmaug 34B V0.1 GPTQ
Repository 🤗https://huggingface.co/LoneStriker/Smaug-34B-v0.1-GPTQ 
Base Model(s)  jondurbin/bagel-34b-v0.2   jondurbin/bagel-34b-v0.2
Model Size34b
Required VRAM21.2 GB
Updated2026-07-28
MaintainerLoneStriker
Model Typellama
Model Files  21.2 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length200000
Model Max Length200000
Transformers Version4.37.1
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size64000
Torch Data Typefloat16

Best Alternatives to Smaug 34B V0.1 GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Yi 34B 200K RPMerge GPTQ195K / 21.2 GB24
Tess 34B V1.5B GPTQ195K / 18.6 GB188
...4B 200K DARE Megamerge V8 GPTQ195K / 18.6 GB43
...y 34B 200K Chat Evaluator GPTQ195K / 18.6 GB83
Deepmoney 34B 200K Base GPTQ195K / 18.6 GB33
...ous Capybara Limarpv3 34B GPTQ195K / 18.6 GB114
Bagel 34B V0.2 GPTQ195K / 18.6 GB72
Bagel DPO 34B V0.2 GPTQ195K / 18.6 GB52
Nontoxic Bagel 34B V0.2 GPTQ195K / 18.6 GB31
Yi 34B 200K AEZAKMI V2 GPTQ195K / 18.6 GB62
Note: green Score (e.g. "73.2") means that the model is better than LoneStriker/Smaug-34B-v0.1-GPTQ.