LLM EXPLORER 60,277 MODELS INDEXED

Simbert Distill 4L192H by WangZeJun

By WangZeJun · 1 downloads

Simbert Distill 4L192H is an open-source language model by WangZeJun. Features: 4.5m LLM, Context: 0.5K, LLM Explorer Score: 0.03.

  Endpoints compatible   Pytorch   Region:us   Safetensors

Simbert Distill 4L192H Parameters and Internals

Model Type 
text similarity, text generation
Use Cases 
Areas:
text understanding, short text similarity
Applications:
sentence similarity analysis, text matching
Primary Use Cases:
text matching, semantic search
Training Details 
Methodology:
Distillation from BERT-based models
Model Architecture:
BERT-based architecture optimized through distillation
Input Output 
Input Format:
Text inputs (typically sentences)
Accepted Modalities:
text
Output Format:
Similarity score or generated text
LLM NameSimbert Distill 4L192H
Repository πŸ€—https://huggingface.co/WangZeJun/simbert_distill_4L192H 
Model Size4.5m
Required VRAM0 GB
Updated2026-08-01
MaintainerWangZeJun
Model Files  0.0 GB   0.0 GB
Model ArchitectureAutoModel
Context Length512
Model Max Length512
Vocabulary Size13685

Best Alternatives to Simbert Distill 4L192H

Best Alternatives
Context / RAM
Downloads
Likes
...ai Promptmkr Dolphin Phi3 Lora0K / 0.2 GB02
Note: green Score (e.g. "73.2") means that the model is better than WangZeJun/simbert_distill_4L192H.