Starcoderbase is an open-source language model by bigcode. Features: LLM, VRAM: 63.3GB, License: proprietary, Code Generating, LLM Explorer Score: 0.13, Arc: 30.3, HellaSwag: 47.2, MMLU: 32.1, GSM8K: 7.9, HumanEval: 30.4.
Starcoderbase Parameters and Internals
Model Type
Use Cases
Areas: code generation and technical assistance
Applications: code completion, debugging
Limitations: The generated code may not work as intended, might be inefficient, contain bugs or exploits.
Considerations: Generated code may require further validation.
Additional Notes StarCoderBase models are not instruction models.
Supported Languages Programming Languages (80+)
Training Details
Data Sources:
Data Volume:
Methodology: Fill-in-the-Middle objective
Context Length:
Training Time:
Hardware Used:
Model Architecture: GPT-2 model with multi-query attention
Rank the Starcoderbase capabilities
Have you tried this model? Rate its performance β this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Starcoderbase
Expand