LLM EXPLORER 59,420 MODELS INDEXED

Phi 3.5 Mini Instruct Onnx by microsoft

By microsoft · 138 downloads
HF Repo ↗ Copy URL

Phi 3.5 Mini Instruct Onnx is an open-source language model by microsoft. Features: LLM, Context: 128K, License: mit, Instruction-Based, LLM Explorer Score: 0.15.

  Arxiv:2306.00978   Conversational   Custom code   Dml   Instruct   Onnx   Onnxruntime   Phi3   Region:us
Model Card on HF 🤗: https://huggingface.co/microsoft/Phi-3.5-mini-instruct-onnx 

Phi 3.5 Mini Instruct Onnx Parameters and Internals

Model Type 
ONNX
Use Cases 
Areas:
commercial use, research
Applications:
general purpose AI systems
Primary Use Cases:
memory/compute constrained environments, latency bound scenarios, strong reasoning (especially code, math and logic)
Considerations:
Developers should consider common limitations of language models as they select use cases and evaluate and mitigate for accuracy, safety, and fairness.
Additional Notes 
Activation Aware Quantization (AWQ) works by identifying the top 1% most salient weights that are most important for maintaining accuracy and quantizing the remaining 99% of weights.
Training Details 
Data Sources:
synthetic data, filtered publicly available websites
Methodology:
supervised fine-tuning, proximal policy optimization, direct preference optimization
Context Length:
128000
Release Notes 
Version:
Phi-3.5-Mini-Instruct ONNX
Notes:
Update over the instruction-tuned Phi-3 Mini ONNX model release.
LLM NamePhi 3.5 Mini Instruct Onnx
Repository 🤗https://huggingface.co/microsoft/Phi-3.5-mini-instruct-onnx 
Updated2026-07-02
Maintainermicrosoft
Model Typephi3
Instruction-BasedYes
Model ArchitecturePhi3ForCausalLM
Licensemit
Context Length131072
Model Max Length131072
Transformers Version4.43.3
Vocabulary Size32064
Torch Data Typebfloat16

Best Alternatives to Phi 3.5 Mini Instruct Onnx

Best Alternatives
Context / RAM
Downloads
Likes
Phi 4 Mini Instruct ONNX GQA128K /  GB476
Phi 3.5 Mini Instruct Onnx Web128K /  GB40715
Phi 3 Mini 128K Instruct Onnx128K /  GB86193
...i 3 Mini 128K Instruct Ov Int4128K / 2 GB80
...Medium 128K Instruct Onnx Cuda128K /  GB8224
... Medium 128K Instruct Onnx Cpu128K /  GB8414
...um 128K Instruct Onnx Directml128K /  GB896
...3 Mini 128K Instruct Asym Int4128K / 2.5 GB1220
Meeting Model Phi3 128k128K / 7.7 GB50
Model1128K / 0.8 GB200
Note: green Score (e.g. "73.2") means that the model is better than microsoft/Phi-3.5-mini-instruct-onnx.