LLM EXPLORER 63,407 MODELS INDEXED

Phi 2 Orange by rhysjones

By rhysjones · 25 downloads

Phi 2 Orange is an open-source language model by rhysjones. Features: 2.8b LLM, VRAM: 5.6GB, License: mit, LLM Explorer Score: 0.1.

  Custom code Dataset:argilla/ultrafeedback-...   Dataset:intel/orca dpo pairs   Dataset:ldjnr/capybara   Dataset:ldjnr/pure-dove   Dataset:ldjnr/verified-camel   Dataset:meta-math/metamathqa Dataset:migtissera/synthia-v1.... Dataset:open-orca/slimorca-ded...   Endpoints compatible   Phi-msft   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF πŸ€—: https://huggingface.co/rhysjones/phi-2-orange 

Phi 2 Orange Parameters and Internals

Model Type 
text generation
Additional Notes 
An updated model is available at [rhysjones/phi-2-orange-v2](https://huggingface.co/rhysjones/phi-2-orange-v2) with higher evaluations.
Training Details 
Data Sources:
Open-Orca/SlimOrca-Dedup, migtissera/Synthia-v1.3, LDJnr/Verified-Camel, LDJnr/Pure-Dove, LDJnr/Capybara, meta-math/MetaMathQA, Intel/orca_dpo_pairs, argilla/ultrafeedback-binarized-preferences-cleaned
Methodology:
Two-step fine-tuning: a collection of broad training data followed by DPO fine-tuning
Input Output 
Input Format:
ChatML
Accepted Modalities:
text
Output Format:
Markdown format for Python outputs
LLM NamePhi 2 Orange
Repository πŸ€—https://huggingface.co/rhysjones/phi-2-orange 
Model Size2.8b
Required VRAM5.6 GB
Updated2026-05-27
Maintainerrhysjones
Model Typephi-msft
Model Files  5.0 GB: 1-of-2   0.6 GB: 2-of-2
Model ArchitecturePhiForCausalLM
Licensemit
Model Max Length2048
Transformers Version4.37.0.dev0
Tokenizer ClassCodeGenTokenizer
Padding Token<|endoftext|>
Vocabulary Size51200
Torch Data Typebfloat16
Activation Functiongelu_new

Quantized Models of the Phi 2 Orange

Model
Likes
Downloads
VRAM
Phi 2 Orange GGUF205911 GB
Phi 2 Orange GPTQ4171 GB

Best Alternatives to Phi 2 Orange

Best Alternatives
Context / RAM
Downloads
Likes
MFANN3bv0.24128K / 11.1 GB60
MFANN3b128K / 11.1 GB860
MFANN3bv1.4128K / 11.1 GB80
MFANN Phigments Slerp V3.2128K / 5.6 GB60
MFANN3bv1.3128K / 11.1 GB140
MFANN3bv0.23128K / 11.1 GB100
MFANN3bv1.1128K / 11.1 GB100
MFANN3bv1.5128K / 11.1 GB80
MFANN Liminerity Slerp 4a128K / 5.6 GB70
MFANN3b Rebase128K / 11.1 GB70
Note: green Score (e.g. "73.2") means that the model is better than rhysjones/phi-2-orange.