LLM EXPLORER 59,420 MODELS INDEXED

Ymail Search Phi3 Vllm Model 4B by kevin36524

By kevin36524 · 7 downloads

Ymail Search Phi3 Vllm Model 4B is an open-source language model by kevin36524. Features: 4b LLM, VRAM: 2.3GB, Context: 4K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

  4-bit   4bit   Bitsandbytes   Conversational   En   Endpoints compatible   Instruct   Mistral   Quantized   Region:us   Safetensors   Sft   Trl   Unsloth

Ymail Search Phi3 Vllm Model 4B Parameters and Internals

Model Type 
text-generation-inference, transformers, unsloth, mistral, trl, sft
Additional Notes 
This mistral model was trained 2x faster using the Unsloth framework and Huggingface's TRL library.
LLM NameYmail Search Phi3 Vllm Model 4b
Repository πŸ€—https://huggingface.co/kevin36524/ymail_search_phi3_vllm_model_4b 
Base Model(s)  unsloth/phi-3-mini-4k-instruct-bnb-4bit   unsloth/phi-3-mini-4k-instruct-bnb-4bit
Model Size4b
Required VRAM2.3 GB
Updated2026-06-30
Maintainerkevin36524
Model Typemistral
Instruction-BasedYes
Model Files  2.3 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Padding Token<|placeholder6|>
Vocabulary Size32064
Torch Data Typebfloat16

Best Alternatives to Ymail Search Phi3 Vllm Model 4B

Best Alternatives
Context / RAM
Downloads
Likes
Athena CodePhi 4B 4K V0.14K / 7.6 GB191
Ministral 4B Fork32K / 9 GB90
Ministral 4B Instruct32K / 8.9 GB1008
MistralPh3 4B Slerp4K / 7.8 GB60
Note: green Score (e.g. "73.2") means that the model is better than kevin36524/ymail_search_phi3_vllm_model_4b.