Starcoder2 3B Instruct is an open-source language model by TechxGenus. Features: 3b LLM, VRAM: 6.1GB, Context: 16K, License: bigcode-openrail-m, Instruction-Based, LLM Explorer Score: 0.11.
Model operates using the Alpaca instruction format (excluding the system prompt).
Training Details
Data Volume:
0.7 billion high-quality code-related tokens
Training Time:
3 epochs
Hardware Used:
DeepSpeed ZeRO 3, Flash Attention 2
Safety Evaluation
Ethical Considerations:
Model may sometimes make errors, produce misleading contents, or struggle to manage tasks that are not related to coding. It has undergone very limited testing. Additional safety testing should be performed before any real-world deployments.