Phi 3 Small 8K Instruct is an open-source language model by microsoft. Features: 7.4b LLM, VRAM: 14.8GB, Context: 8K, License: mit, Instruction-Based, LLM Explorer Score: 0.38, ELO: 1171.
Phi 3 Small 8K Instruct Benchmarks
nn.n%
Phi 3 Small 8K Instruct Parameters and Internals
Model Type Use Cases
Areas: Primary Use Cases: Memory/compute constrained environments, Latency bound scenarios, Strong reasoning (code, math, logic)
Limitations: Languages other than English will experience worse performance, Reinforcement of stereotypes
Considerations: Common limitations of language models should be considered.
Additional Notes This is a static model trained on an offline dataset with cutoff date October 2023. Future versions may be released.
Supported Languages Training Details
Data Sources: synthetic data, filtered publicly available websites
Data Volume: Methodology: Fine-tuned with Supervised fine-tuning (SFT) and Direct Preference Optimization (DPO)
Context Length: Training Time: Hardware Used: Model Architecture: Dense decoder-only Transformer model with alternating dense and blocksparse attentions
Responsible Ai Considerations
Fairness: Potential bias due to the training data's representation.
Mitigation Strategies: Post-training for safety measures.
Input Output
Input Format: Accepted Modalities: Output Format:
Release Notes
Version: Notes: Model weight is released.
Rank the Phi 3 Small 8K Instruct capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Phi 3 Small 8K Instruct
Expand