LLM EXPLORER 59,420 MODELS INDEXED

Stablecode Completion Alpha 3B 4K GPTQ by TheBloke

By TheBloke · 6 downloads

Stablecode Completion Alpha 3B 4K GPTQ is an open-source language model by TheBloke. Features: 3b LLM, VRAM: 1.8GB, Context: 4K, License: apache-2.0, Quantized, Code Generating, LLM Explorer Score: 0.08.

  Arxiv:1910.02054   Arxiv:2104.09864   4-bit Base model:quantized:stability... Base model:stabilityai/stablec...   Code   Codegen   Dataset:bigcode/starcoderdata   Gpt neox   Gptq   Model-index   Quantized   Region:us   Safetensors

Stablecode Completion Alpha 3B 4K GPTQ Parameters and Internals

Model Type 
causal-lm, text-generation
Use Cases 
Areas:
Research, Commercial applications
Applications:
Code completion
Primary Use Cases:
Single/multiline code completion from a long context window up to 4k tokens.
Limitations:
Not intended for unlawful content or activities with high risk of harm.
Considerations:
Use in conjunction with tools like HuggingFace's VSCode extension for responsible usage.
Additional Notes 
TheBloke's LLM work is supported by andreessen horowitz (a16z) grant. Multiple quantisation parameters provided allowing for various hardware compatibility.
Supported Languages 
code (Programming languages that topped the StackOverflow developer survey.)
Training Details 
Data Sources:
bigcode/starcoder-data
Data Volume:
300 billion tokens
Methodology:
Pre-trained at a context length of 4096 for 300 billion tokens
Context Length:
4096
Model Architecture:
Auto-regressive language models based on transformer decoder architecture, trained under 2D parallelism with ZeRO-1 and uses rotary embedding kernels.
Input Output 
Input Format:
Tokens up to 4k
Accepted Modalities:
Text
Output Format:
Generated code
LLM NameStablecode Completion Alpha 3B 4K GPTQ
Repository πŸ€—https://huggingface.co/TheBloke/stablecode-completion-alpha-3b-4k-GPTQ 
Model CreatorStabilityAI
Base Model(s)  ...blecode Completion Alpha 3B 4K   stabilityai/stablecode-completion-alpha-3b-4k
Model Size3b
Required VRAM1.8 GB
Updated2026-07-29
MaintainerTheBloke
Model Typegpt_neox
Model Files  1.8 GB
Supported Languagescode
GPTQ QuantizationYes
Quantization Typegptq
Generates CodeYes
Model ArchitectureGPTNeoXForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.30.2
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size49152
Torch Data Typefloat16

Best Alternatives to Stablecode Completion Alpha 3B 4K GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...blecode Instruct Alpha 3B GPTQ4K / 1.8 GB1017
...blecode Instruct Alpha 3B GPTQ4K / 1.8 GB51
Stablecode Completion Alpha 3B16K / 14.1 GB180119
...blecode Completion Alpha 3B 4K4K / 6.1 GB434278
Stablecode Instruct Alpha 3B4K / 6.1 GB2304
StableCode 3B4K / 6.1 GB81
...tion Alpha 3B 4K Openvino Int84K / 2.8 GB81
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/stablecode-completion-alpha-3b-4k-GPTQ.