Tinyllama Coder Py 4bit V10 Parameters and Internals
Model Type
text-generation, Python Coder
Additional Notes
The model was refined using Unsloath. The dataset ise-uiuc/Magicoder-OSS-Instruct-75K was adjusted, leaving only data on Python and divided into 10 parts, each refinement occurred for 2 epochs, using Adafactor optimizer or AdamW_8bit (Adafactor seems to deliver less loss).
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.