Starcoderplus Guanaco GPT4 15B V1.0 GPTQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Starcoderplus Guanaco GPT4 15B V1.0 GPTQ   URL Share it on

Starcoderplus Guanaco GPT4 15B V1.0 GPTQ is an open-source language model by TheBloke. Features: 15b LLM, VRAM: 9.2GB, License: apache-2.0, Quantized, Code Generating, LLM Explorer Score: 0.08.

  4-bit   Autotrain compatible   Codegen   Dataset:guanaco   En   Gpt bigcode   Gptq   Quantized   Region:us   Safetensors

Starcoderplus Guanaco GPT4 15B V1.0 GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Starcoderplus Guanaco GPT4 15B V1.0 GPTQ (TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ)
๐ŸŒŸ Advertise your project ๐Ÿš€

Starcoderplus Guanaco GPT4 15B V1.0 GPTQ Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
research, commercial applications
Applications:
question-answering, text summarization, essay writing, translation
Primary Use Cases:
English language question-answering systems
Limitations:
Knowledge is up-to-date only until training time., Can produce incorrect or nonsensical responses
Considerations:
Use as a tool to assist in generating text.
Supported Languages 
en (Full proficiency)
Training Details 
Data Sources:
openassistant-guanaco dataset (re-imagined using GPT-4 answers)
Methodology:
Finetuned using QLORA.
Model Architecture:
Starcoderplus
Input Output 
Input Format:
### Human: {prompt} ### Assistant:
Accepted Modalities:
text
Output Format:
text
LLM NameStarcoderplus Guanaco GPT4 15B V1.0 GPTQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ 
Base Model(s)  LoupGarou/Starcoderplus-Guanaco-GPT4-15B-V1.0   LoupGarou/Starcoderplus-Guanaco-GPT4-15B-V1.0
Model Size15b
Required VRAM9.2 GB
Updated2025-09-23
MaintainerTheBloke
Model Typegpt_bigcode
Model Files  9.2 GB
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Licenseapache-2.0
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typefloat32
Activation Functiongelu

Best Alternatives to Starcoderplus Guanaco GPT4 15B V1.0 GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...ardCoder Guanaco 15B V1.1 GPTQ0K / 9.2 GB4012
...ardCoder Guanaco 15B V1.0 GPTQ0K / 9.2 GB716
WizardCoder 15B 1.0 GPTQ0K / 9.2 GB968177
Minotaur 15B GPTQ0K / 9.2 GB458
Minotaur 15B 8bit0K / 16.5 GB80
WizardCoder 15B V1.0 8bit0K / 16.5 GB71
Starcoder 15b 8bit0K /  GB174
Starcoder 15b 8bit0K /  GB44
Starcoder 15b 4bit0K /  GB122
Starcoder 15b 4bit0K /  GB82
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ.

Rank the Starcoderplus Guanaco GPT4 15B V1.0 GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52473 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a