LLM EXPLORER 60,783 MODELS INDEXED

Solar Pro Preview Instruct by upstage

By upstage · 42941 downloads
HF Repo ↗ Copy URL

Solar Pro Preview Instruct is an open-source language model by upstage. Features: 22.1b LLM, VRAM: 44.5GB, Context: 4K, License: mit, Instruction-Based, LLM Explorer Score: 0.33.

  Conversational   Custom code   En   Instruct   Region:us   Safetensors   Sharded   Solar   Tensorflow
Model Card on HF 🤗: https://huggingface.co/upstage/solar-pro-preview-instruct 

Solar Pro Preview Instruct Parameters and Internals

Model Type 
text-generation, instruction-following
Use Cases 
Areas:
research, commercial applications
Applications:
conversational tasks, instruction-following tasks
Primary Use Cases:
instruction-tuned tasks, chat interactions
Limitations:
Limited language coverage (English), maximum context length of 4K
Additional Notes 
Solar Pro Preview is a pre-release with an official version expected in November 2024, featuring expanded language support and longer context windows.
Supported Languages 
en (high)
Training Details 
Methodology:
Enhanced depth up-scaling method, training strategy on MMLU-Pro and IFEval benchmarks
Context Length:
4000
Hardware Used:
GPU with 80GB of VRAM
Input Output 
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Use the ChatML template for optimal performance in conversational and instruction-following tasks.
LLM NameSolar Pro Preview Instruct
Repository 🤗https://huggingface.co/upstage/solar-pro-preview-instruct 
Model Size22.1b
Required VRAM44.5 GB
Updated2026-07-15
Maintainerupstage
Model Typesolar
Instruction-BasedYes
Model Files  4.9 GB: 1-of-9   5.0 GB: 2-of-9   4.9 GB: 3-of-9   5.0 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   4.8 GB: 9-of-9
Supported Languagesen
Model ArchitectureSolarForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.44.2
Tokenizer ClassLlamaTokenizer
Padding Token<|im_end|>
Vocabulary Size32128
Torch Data Typebfloat16

Quantized Models of the Solar Pro Preview Instruct

Model
Likes
Downloads
VRAM
...olar Pro Preview Instruct GGUF291428844 GB