LLM EXPLORER 63,529 MODELS INDEXED

Bert Medium by prajjwal1

By prajjwal1 · 595777 downloads

Bert Medium is an open-source language model by prajjwal1. Features: LLM, VRAM: 0.2GB, Context: 0.5K, License: mit, LLM Explorer Score: 0.08.

  Arxiv:1908.08962   Arxiv:2110.01518   Bert   En   Endpoints compatible   Mnli   Nli   Pre-training   Pytorch   Region:us
Model Card on HF πŸ€—: https://huggingface.co/prajjwal1/bert-medium 

Bert Medium Parameters and Internals

Model Type 
transformer, pre-training, NLI
Use Cases 
Areas:
Natural Language Inference (NLI), Pre-training
Primary Use Cases:
Trained on downstream tasks
Additional Notes 
The model is one of the smaller pre-trained BERT variants, recommended to be trained on downstream tasks.
Supported Languages 
English (unknown)
Training Details 
Methodology:
Pytorch pre-trained model converted from Tensorflow checkpoint
Model Architecture:
L=8, H=512
LLM NameBert Medium
Repository πŸ€—https://huggingface.co/prajjwal1/bert-medium 
Required VRAM0.2 GB
Updated2026-08-07
Maintainerprajjwal1
Model Files  0.2 GB
Supported Languagesen
Model ArchitectureAutoModel
Licensemit
Context Length512
Model Max Length512
Vocabulary Size30522

Best Alternatives to Bert Medium

Best Alternatives
Context / RAM
Downloads
Likes
Distil Longformer Base 40964K / 0.4 GB60
Daedalus 11K /  GB91
Opengpt2 Pytorch Backward1K / 6 GB3251
Tiny Random Detr1K / 0.2 GB150
Opengpt2 Pytorch Forward1K / 6 GB21
Finsent Transformer0.5K / 0.4 GB11
Bert Chinese L 12 H 768 A 120.5K / 0.4 GB91
Simbert Chinese Base0.5K / 0.4 GB110
Simbert Chinese Tiny0.5K / 0 GB90
Bert Tiny0.5K / 0 GB1360936147
Note: green Score (e.g. "73.2") means that the model is better than prajjwal1/bert-medium.