LLM EXPLORER 59,516 MODELS INDEXED

Cognitivecomputations Dolphin 2.9.2 Phi 3 Medium Bnb 4bit Smashed by PrunaAI

By PrunaAI · 5 downloads

Cognitivecomputations Dolphin 2.9.2 Phi 3 Medium Bnb 4bit Smashed is an open-source language model by PrunaAI. Features: 7.4b LLM, VRAM: 8.4GB, Context: 4K, Quantized, LLM Explorer Score: 0.13.

  4-bit   4bit Base model:cognitivecomputatio... Base model:quantized:cognitive...   Bitsandbytes   Mistral   Pruna-ai   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Cognitivecomputations Dolphin 2.9.2 Phi 3 Medium Bnb 4bit Smashed Parameters and Internals

Additional Notes 
The model format is safetensors. Efficiency results may vary in other settings (e.g., other hardware, image size, batch size, ...).
Training Details 
Data Sources:
WikiText
Methodology:
Compressed with llm-int8.
LLM NameCognitivecomputations Dolphin 2.9.2 Phi 3 Medium Bnb 4bit Smashed
Repository πŸ€—https://huggingface.co/PrunaAI/cognitivecomputations-dolphin-2.9.2-Phi-3-Medium-bnb-4bit-smashed 
Base Model(s)  cognitivecomputations/dolphin-2.9.2-Phi-3-Medium   cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
Model Size7.4b
Required VRAM8.4 GB
Updated2025-09-23
MaintainerPrunaAI
Model Typemistral
Model Files  5.0 GB: 1-of-2   3.4 GB: 2-of-2
Quantization Type4bit
Model ArchitectureMistralForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.40.0
Tokenizer ClassLlamaTokenizer
Padding Token<|placeholder6|>
Vocabulary Size32064
Torch Data Typefloat16

Best Alternatives to Cognitivecomputations Dolphin 2.9.2 Phi 3 Medium Bnb 4bit Smashed

Best Alternatives
Context / RAM
Downloads
Likes
Tamtanai32K / 14.8 GB100
Mistral Ko Inst Dev32K / 14.8 GB84