Openbuddy Mistral 7B V13 Base GPTQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Openbuddy Mistral 7B V13 Base GPTQ   URL Share it on

  4-bit   Autotrain compatible Base model:openbuddy/openbuddy... Base model:quantized:openbuddy...   De   En   Fr   Gptq   It   Ja   Ko   Mistral   Quantized   Region:us   Ru   Safetensors   Zh

Openbuddy Mistral 7B V13 Base GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Openbuddy Mistral 7B V13 Base GPTQ (TheBloke/openbuddy-mistral-7B-v13-base-GPTQ)
๐ŸŒŸ Advertise your project ๐Ÿš€

Openbuddy Mistral 7B V13 Base GPTQ Parameters and Internals

Model Type 
text-generation
Use Cases 
Areas:
research, specialized domain-specific applications
Primary Use Cases:
fine-tuning and deployment of specialized models
Limitations:
not heavily fine-tuned for conversational tasks
Considerations:
Not intended for critical or high-stake scenarios.
Additional Notes 
Base-series models use approximately 50% conversational data and are not extensively tuned for conversational tasks.
Supported Languages 
English (en), Chinese (Simplified) (zh), French (fr), German (de), Japanese (ja), Korean (ko), Italian (it), Russian (ru)
Safety Evaluation 
Ethical Considerations:
All OpenBuddy models have inherent limitations and may potentially produce outputs that are erroneous, harmful, or undesirable.
Input Output 
Input Format:
{prompt}
Accepted Modalities:
text
LLM NameOpenbuddy Mistral 7B V13 Base GPTQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/openbuddy-mistral-7B-v13-base-GPTQ 
Model NameOpenBuddy Mistral 7B v13 Base
Model CreatorOpenBuddy
Base Model(s)  Openbuddy Mistral 7B V13 Base   OpenBuddy/openbuddy-mistral-7b-v13-base
Model Size7b
Required VRAM4.2 GB
Updated2025-09-23
MaintainerTheBloke
Model Typemistral
Model Files  4.2 GB
Supported Languageszh en fr de ja ko it ru
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.34.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size36608
Torch Data Typefloat16

Best Alternatives to Openbuddy Mistral 7B V13 Base GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...enHermes 2.5 Mistral 7B Marlin32K / 4.1 GB5842
Zephyr 7B Beta Marlin32K / 4.1 GB1050
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB522722
...ral 7B Instruct V0.3 GPTQ 4bit32K / 4.2 GB294618
...ephyr 7B Beta Channelwise Gptq32K / 4 GB64690
Mistral 7B Instruct V0.3 GPTQ32K / 4.2 GB3831
...istral 7B Pruned50 GPTQ Marlin32K / 4 GB60
Mistral 7B Unsloth Gptq 8bit32K / 7.7 GB70
Mistral 7B Instruct V0.2 GPTQ32K / 4.2 GB599854
...phyr 7B Beta Assistant V1 Gptq32K / 4.2 GB61
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/openbuddy-mistral-7B-v13-base-GPTQ.

Rank the Openbuddy Mistral 7B V13 Base GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51539 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124