LLM EXPLORER 58,608 MODELS INDEXED

Phi 3 Small 8K Instruct Onnx Cuda by microsoft

By microsoft · 44 downloads
HF Repo ↗ Copy URL

Phi 3 Small 8K Instruct Onnx Cuda is an open-source language model by microsoft. Features: LLM, Context: 8K, License: mit, Instruction-Based, LLM Explorer Score: 0.13.

  Conversational   Custom code   Dml   Ext 8k   Instruct   Onnx   Onnxruntime   Phi3   Phi3small   Region:us
Model Card on HF 🤗: https://huggingface.co/microsoft/Phi-3-small-8k-instruct-onnx-cuda 

Phi 3 Small 8K Instruct Onnx Cuda Parameters and Internals

Model Type 
nlp, conversational, text-generation
Use Cases 
Areas:
Research, Commercial applications
Applications:
Conversational agents, Natural Language Processing tasks
Additional Notes 
Models use ONNX Runtime for accelerated inference with Nvidia GPUs. Available in FP16 and INT4 CUDA formats for different batch size optimizations.
Training Details 
Data Sources:
Phi-3 datasets, which include synthetic data and filtered publicly available website data
Methodology:
Supervised fine-tuning and direct preference optimization for instruction following and safety measures.
Context Length:
8000
LLM NamePhi 3 Small 8K Instruct Onnx Cuda
Repository 🤗https://huggingface.co/microsoft/Phi-3-small-8k-instruct-onnx-cuda 
Updated2026-07-16
Maintainermicrosoft
Model Typephi3small
Instruction-BasedYes
Context Length8k
Model ArchitecturePhi3SmallForCausalLM
Licensemit
Context Length8192
Model Max Length8192
Transformers Version4.38.1
Vocabulary Size100352
Torch Data Typebfloat16

Best Alternatives to Phi 3 Small 8K Instruct Onnx Cuda

Best Alternatives
Context / RAM
Downloads
Likes
... Small 128K Instruct Onnx Cuda128K /  GB3013