LLM EXPLORER 59,420 MODELS INDEXED

Orca Mini V3 70B by pankajmathur

By pankajmathur · 129 downloads
HF Repo ↗ Copy URL

Orca Mini V3 70B is an open-source language model by pankajmathur. Features: 70b LLM, VRAM: 138GB, Context: 4K, License: other, Quantized, LLM Explorer Score: 0.15.

  Arxiv:2306.02707   Dataset:ehartford/dolphin Dataset:psmathur/orca mini v1 ...   En   Endpoints compatible   Fp16   Llama   Model-index   Pytorch   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/pankajmathur/orca_mini_v3_70b 

Orca Mini V3 70B Parameters and Internals

Model Type 
text-generation
Additional Notes 
This model occasionally produces inaccurate or misleading results. It can sometimes generate inappropriate, biased, or offensive content.
Input Output 
Input Format:
Prompt format requires context of AI assistant interaction
Accepted Modalities:
text
Output Format:
Text generation output
LLM NameOrca Mini V3 70b
Repository 🤗https://huggingface.co/pankajmathur/orca_mini_v3_70b 
Model Size70b
Required VRAM138 GB
Updated2026-08-08
Maintainerpankajmathur
Model Typellama
Model Files  9.8 GB: 1-of-15   9.8 GB: 2-of-15   10.0 GB: 3-of-15   9.8 GB: 4-of-15   9.8 GB: 5-of-15   9.8 GB: 6-of-15   10.0 GB: 7-of-15   9.8 GB: 8-of-15   9.8 GB: 9-of-15   9.8 GB: 10-of-15   10.0 GB: 11-of-15   9.8 GB: 12-of-15   9.8 GB: 13-of-15   9.5 GB: 14-of-15   0.5 GB: 15-of-15   9.8 GB: 1-of-15   9.8 GB: 2-of-15   10.0 GB: 3-of-15   9.8 GB: 4-of-15   9.8 GB: 5-of-15   9.8 GB: 6-of-15   10.0 GB: 7-of-15   9.8 GB: 8-of-15   9.8 GB: 9-of-15   9.8 GB: 10-of-15   10.0 GB: 11-of-15   9.8 GB: 12-of-15   9.8 GB: 13-of-15   9.5 GB: 14-of-15   0.5 GB: 15-of-15
Supported Languagesen
Quantization Typefp16
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.32.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Orca Mini V3 70B

Best Alternatives
Context / RAM
Downloads
Likes
...B Instruct Gradient 1048K 8bit1024K / 75 GB415
...B Instruct Gradient 1048K 4bit1024K / 39.7 GB253
...B Instruct Gradient 1048K 2bit1024K / 21.9 GB252
...0B Instruct Gradient 262K 4bit256K / 39.7 GB253
...0B Instruct Gradient 262K 8bit256K / 75 GB262
...0B Instruct Gradient 262K 2bit256K / 21.9 GB201
... Gradient 262K 2.25bpw H6 EXL2256K / 22.2 GB80
...t Gradient 262K 4.0bpw H6 EXL2256K / 37.2 GB71
...t Gradient 262K 2.4bpw H6 EXL2256K / 23.5 GB60
...t Gradient 262K 3.5bpw H6 EXL2256K / 32.9 GB60