LLM EXPLORER 61,918 MODELS INDEXED

Starcoderbase by bigcode

By bigcode · 1144 downloads

Starcoderbase is an open-source language model by bigcode. Features: LLM, VRAM: 63.3GB, License: proprietary, Code Generating, LLM Explorer Score: 0.13, Arc: 30.3, HellaSwag: 47.2, MMLU: 32.1, GSM8K: 7.9, HumanEval: 30.4.

  Arxiv:1911.02150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.06161   Code   Codegen Dataset:bigcode/the-stack-dedu...   Endpoints compatible   Gpt bigcode   Model-index   Pytorch   Region:us   Sharded
Model Card on HF πŸ€—: https://huggingface.co/bigcode/starcoderbase 

Starcoderbase Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
code generation and technical assistance
Applications:
code completion, debugging
Limitations:
The generated code may not work as intended, might be inefficient, contain bugs or exploits.
Considerations:
Generated code may require further validation.
Additional Notes 
StarCoderBase models are not instruction models.
Supported Languages 
Programming Languages (80+)
Training Details 
Data Sources:
The Stack (v1.2)
Data Volume:
1 trillion tokens
Methodology:
Fill-in-the-Middle objective
Context Length:
8192
Training Time:
24 days
Hardware Used:
512 Tesla A100 GPUs
Model Architecture:
GPT-2 model with multi-query attention
LLM NameStarcoderbase
Repository πŸ€—https://huggingface.co/bigcode/starcoderbase 
Required VRAM63.3 GB
Updated2026-07-13
Maintainerbigcode
Model Typegpt_bigcode
Model Files  9.9 GB: 1-of-7   9.9 GB: 2-of-7   9.8 GB: 3-of-7   9.9 GB: 4-of-7   9.8 GB: 5-of-7   9.9 GB: 6-of-7   4.1 GB: 7-of-7
Gated ModelYes
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Licenseproprietary
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typefloat32
Activation Functiongelu

Best Alternatives to Starcoderbase

Best Alternatives
Context / RAM
Downloads
Likes
Sqlcoder20K / 31.2 GB4411117
...rcoder Gpteacher Code Instruct0K / 63.3 GB6580
Opencoderplus0K / 31.8 GB203103
StarCoder Alpaca0K / 31 GB3791
Sqlcoder0K / 31.2 GB223328
SteloCoder0K / 31.2 GB141
Minicoder Random0K / 0.1 GB100
Minicoder Lua0K / 0.1 GB80
Tiny Starcoder Py0K /  GB2062
DPO Santacoder1b0K / 2.2 GB90