LLM EXPLORER 59,420 MODELS INDEXED

SauerkrautLM SOLAR Instruct GPTQ by TheBloke

By TheBloke · 8 downloads
HF Repo ↗ Copy URL

SauerkrautLM SOLAR Instruct GPTQ is an open-source language model by TheBloke. Features: 10.7b LLM, VRAM: 6GB, Context: 8K, License: cc-by-nc-4.0, Quantized, Instruction-Based, LLM Explorer Score: 0.1.

  4-bit   Augmentation Base model:quantized:vagosolut... Base model:vagosolutions/sauer...   Conversational Dataset:argilla/distilabel-mat...   De   Dpo   En   Finetuned   German   Gptq   Instruct   Llama   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ 

SauerkrautLM SOLAR Instruct GPTQ Parameters and Internals

Model Type 
solar, text-generation
Additional Notes 
Despite efforts in data cleansing, possibility of uncensored content slipping through cannot be entirely ruled out. Licensing does not constitute legal advice.
Supported Languages 
en (proficient), de (proficient)
Training Details 
Data Sources:
argilla/distilabel-math-preference-dpo, HuggingFaceH4/ultrafeedback_binarized, SauerkrautLM-DPO, Sauerkraut-7b-HerO
Methodology:
Fine-tuned using DPO and German data augmentation techniques
Input Output 
Input Format:
### User: {prompt} ### Assistant:
Accepted Modalities:
text
LLM NameSauerkrautLM SOLAR Instruct GPTQ
Repository 🤗https://huggingface.co/TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ 
Model NameSauerkrautLM SOLAR Instruct
Model CreatorVAGO solutions
Base Model(s)  SauerkrautLM SOLAR Instruct   VAGOsolutions/SauerkrautLM-SOLAR-Instruct
Model Size10.7b
Required VRAM6 GB
Updated2026-07-28
MaintainerTheBloke
Model Typesolar
Instruction-BasedYes
Model Files  6.0 GB
Supported Languagesen de
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licensecc-by-nc-4.0
Context Length8192
Model Max Length8192
Transformers Version4.35.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to SauerkrautLM SOLAR Instruct GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Sakura SOLAR Instruct GPTQ4K / 6 GB23
SOLAR 10.7B Instruct V1.0 GPTQ4K / 6 GB42
...rautLM UNA SOLAR Instruct GPTQ4K / 6 GB63
...UNA SOLARkrautLM Instruct GPTQ4K / 6 GB82
SOLAR 10.7B Instruct V1.0 GPTQ4K / 6 GB1412
... 10.7B Instruct V1.0 128K EXL2128K / 5.6 GB51
... Instruct V1.0 Uncensored GPTQ4K / 6 GB7113
Eclectus 1.1 Dedup4K / 21.4 GB50
Eclectus1.14K / 21.4 GB60
Solar 10.7B SLERP EXL24K / 5.6 GB114
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ.