Phi 3 Vision 128K Instruct is an open-source language model by microsoft. Features: 4.1b LLM, VRAM: 8.3GB, Context: 128K, License: mit, Instruction-Based, LLM Explorer Score: 0.23.
Phi 3 Vision 128K Instruct Parameters and Internals
Model Type multimodal, text generation, vision
Use Cases
Areas:
Applications: general image understanding, OCR, chart and table understanding
Primary Use Cases: memory/compute constrained environments, latency bound scenarios
Limitations: Not evaluated for all downstream purposes, Potential quality degradation in non-English language use cases
Considerations: Developers should mitigate biases and misuses.
Supported Languages languages_supported (multilingual), proficiency_level (English focused, other languages might perform worse.)
Training Details
Data Sources: publicly available documents, high-quality educational data, selected high-quality image-text interleave, synthetic data
Data Volume: 500B vision and text tokens
Methodology: Supervised fine-tuning, direct preference optimization
Context Length:
Training Time:
Hardware Used:
Model Architecture: Image encoder, connector, projector, and Phi-3 Mini language model
Safety Evaluation
Ethical Considerations: Potential for producing inappropriate, unreliable, or biased content due to training data limitations.
Responsible Ai Considerations
Fairness: Potential biases due to varying representation of groups in data.
Transparency: Developers responsible for evaluating model output for fairness and accuracy.
Accountability: Developers should ensure model applications adhere to laws and regulations.
Mitigation Strategies: Safety post-training, adherence to use-case laws.
Input Output
Input Format: Single image with chat format prompts
Accepted Modalities:
Output Format: Text generated in response to input
Rank the Phi 3 Vision 128K Instruct capabilities
Have you tried this model? Rate its performance β this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Phi 3 Vision 128K Instruct
Note: green Score (e.g. "73.2 ") means that the model is better than microsoft/Phi-3-vision-128k-instruct .
Expand