Starcoderbase 7B by smallcloudai

 »  All LLMs  »  smallcloudai  »  Starcoderbase 7B   URL Share it on

Starcoderbase 7B is an open-source language model by smallcloudai. Features: 7b LLM, VRAM: 30.2GB, License: bigcode-openrail-m, Code Generating, LLM Explorer Score: 0.09.

  Arxiv:1911.02150   Arxiv:2205.14135   Arxiv:2207.14255   Arxiv:2305.06161   Code   Codegen Dataset:bigcode/the-stack-dedu...   Endpoints compatible   Gpt bigcode   Model-index   Pytorch   Region:us   Sharded

Starcoderbase 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Starcoderbase 7B Parameters and Internals

LLM NameStarcoderbase 7B
Repository 🤗https://huggingface.co/refactai/starcoderbase-7b 
Model Size7b
Required VRAM30.2 GB
Updated2026-05-16
Maintainersmallcloudai
Model Typegpt_bigcode
Model Files  9.9 GB: 1-of-4   10.0 GB: 2-of-4   9.5 GB: 3-of-4   0.8 GB: 4-of-4
Generates CodeYes
Model ArchitectureGPTBigCodeForCausalLM
Licensebigcode-openrail-m
Transformers Version4.28.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size49152
Torch Data Typefloat32
Activation Functiongelu

Best Alternatives to Starcoderbase 7B

Best Alternatives
Context / RAM
Downloads
Likes
Starcoder 7B Agent 0.2 Merged0K / 14.7 GB520
Codes 7B Merged0K / 29.4 GB80
Codes 7B Spider0K / 29.4 GB110
Starcoderbase 7B0K / 30.2 GB101
Codes 7B Bird0K / 29.4 GB140
Codes 7B Bird With Evidence0K / 29.4 GB120
Codes 7B0K / 29.4 GB2779
Note: green Score (e.g. "73.2") means that the model is better than refactai/starcoderbase-7b.

Rank the Starcoderbase 7B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53743 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a