LLM EXPLORER 59,358 MODELS INDEXED

Bert Tiny by prajjwal1

By prajjwal1 · 1360936 downloads

Bert Tiny is an open-source language model by prajjwal1. Features: LLM, Context: 0.5K, License: mit, LLM Explorer Score: 0.1.

  Arxiv:1908.08962   Arxiv:2110.01518   Bert   En   Endpoints compatible   Mnli   Nli   Pre-training   Pytorch   Region:us
Model Card on HF πŸ€—: https://huggingface.co/prajjwal1/bert-tiny 

Bert Tiny Parameters and Internals

Model Type 
transformer, pre-trained
Use Cases 
Areas:
Natural Language Inference (NLI)
Additional Notes 
This model is a Pytorch version converted from a Tensorflow checkpoint.
Training Details 
Methodology:
Knowledge Distillation
Model Architecture:
L=2, H=128
LLM NameBert Tiny
Repository πŸ€—https://huggingface.co/prajjwal1/bert-tiny 
Required VRAM0 GB
Updated2026-08-01
Maintainerprajjwal1
Model Files  0.0 GB
Supported Languagesen
Model ArchitectureAutoModel
Licensemit
Context Length512
Model Max Length512
Vocabulary Size30522

Best Alternatives to Bert Tiny

Best Alternatives
Context / RAM
Downloads
Likes
Distil Longformer Base 40964K / 0.4 GB60
Daedalus 11K /  GB91
Opengpt2 Pytorch Backward1K / 6 GB3251
Tiny Random Detr1K / 0.2 GB150
Opengpt2 Pytorch Forward1K / 6 GB21
Finsent Transformer0.5K / 0.4 GB11
Bert Chinese L 12 H 768 A 120.5K / 0.4 GB91
Simbert Chinese Base0.5K / 0.4 GB110
Simbert Chinese Tiny0.5K / 0 GB90
All MiniLM L12 V20.5K /  GB16774
Note: green Score (e.g. "73.2") means that the model is better than prajjwal1/bert-tiny.