LLM EXPLORER 63,529 MODELS INDEXED

Bert Mini by prajjwal1

By prajjwal1 · 272630 downloads
HF Repo ↗ Copy URL

Bert Mini is an open-source language model by prajjwal1. Features: LLM, Context: 0.5K, License: mit, LLM Explorer Score: 0.07.

  Arxiv:1908.08962   Arxiv:2110.01518   Bert   En   Endpoints compatible   Mnli   Nli   Pre-training   Pytorch   Region:us
Model Card on HF 🤗: https://huggingface.co/prajjwal1/bert-mini 

Bert Mini Parameters and Internals

Model Type 
pre-trained, Transformer
Use Cases 
Areas:
NLI, Pre-training
Applications:
Natural Language Inference (NLI)
Primary Use Cases:
Pre-training for various NLP applications
Training Details 
Data Sources:
Google BERT repository
Methodology:
Pre-training
Model Architecture:
BERT-based with configuration L=4, H=256
LLM NameBert Mini
Repository 🤗https://huggingface.co/prajjwal1/bert-mini 
Required VRAM0 GB
Updated2026-07-31
Maintainerprajjwal1
Model Files  0.0 GB
Supported Languagesen
Model ArchitectureAutoModel
Licensemit
Context Length512
Model Max Length512
Vocabulary Size30522

Best Alternatives to Bert Mini

Best Alternatives
Context / RAM
Downloads
Likes
Distil Longformer Base 40964K / 0.4 GB60
Daedalus 11K /  GB91
Opengpt2 Pytorch Backward1K / 6 GB3251
Tiny Random Detr1K / 0.2 GB150
Opengpt2 Pytorch Forward1K / 6 GB21
Finsent Transformer0.5K / 0.4 GB11
Bert Chinese L 12 H 768 A 120.5K / 0.4 GB91
Simbert Chinese Base0.5K / 0.4 GB110
Simbert Chinese Tiny0.5K / 0 GB90
Bert Tiny0.5K / 0 GB1360936147
Note: green Score (e.g. "73.2") means that the model is better than prajjwal1/bert-mini.