LLM EXPLORER 61,491 MODELS INDEXED

Orca Mini V9 0 3B Instruct by pankajmathur

By pankajmathur · 11 downloads
HF Repo ↗ Copy URL

Orca Mini V9 0 3B Instruct is an open-source language model by pankajmathur. Features: 3b LLM, VRAM: 6.5GB, Context: 128K, License: llama3.2, Quantized, Instruction-Based, LLM Explorer Score: 0.21.

  4bit Base model:finetune:meta-llama... Base model:meta-llama/llama-3....   Conversational Dataset:pankajmathur/orca mini... Dataset:pankajmathur/orca mini...   En   Endpoints compatible   Instruct   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/pankajmathur/orca_mini_v9_0_3B-Instruct 

Orca Mini V9 0 3B Instruct Parameters and Internals

LLM NameOrca Mini V9 0 3B Instruct
Repository 🤗https://huggingface.co/pankajmathur/orca_mini_v9_0_3B-Instruct 
Base Model(s)  meta-llama/Llama-3.2-3B-Instruct   meta-llama/Llama-3.2-3B-Instruct
Model Size3b
Required VRAM6.5 GB
Updated2026-08-02
Maintainerpankajmathur
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   1.5 GB: 2-of-2
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licensellama3.2
Context Length131072
Model Max Length131072
Transformers Version4.47.1
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|finetune_right_pad_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to Orca Mini V9 0 3B Instruct

Best Alternatives
Context / RAM
Downloads
Likes
Llama3 Finetuned Id 16bit128K / 6.5 GB6520
Slm Rag Sft Merged128K / 6.5 GB2970
Llama3.2 3B Legal Id Ft128K / 6.5 GB2640
...lama 3.2 3B Legal Assistant Id128K / 6.5 GB2830
Fine Tuning LLM128K / 6.5 GB5340
...Llama 3.2 3B Legal Chatbot Sft128K / 6.5 GB8170
Cheese 3B128K / 1.8 GB2491
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Note: green Score (e.g. "73.2") means that the model is better than pankajmathur/orca_mini_v9_0_3B-Instruct.