LLM EXPLORER 59,420 MODELS INDEXED

Transformer 1.3B 100B by fla-hub

By fla-hub · 30490 downloads

Transformer 1.3B 100B is an open-source language model by fla-hub. Features: 100b LLM, VRAM: 2.7GB, Context: 2K, License: mit, LLM Explorer Score: 0.17.

Dataset:cerebras/slimpajama-62...   En   Fla   Region:us   Safetensors   Transformer++

Transformer 1.3B 100B Parameters and Internals

LLM NameTransformer 1.3B 100B
Repository πŸ€—https://huggingface.co/fla-hub/transformer-1.3B-100B 
Model Size100b
Required VRAM2.7 GB
Updated2026-07-29
Maintainerfla-hub
Model Typetransformer
Model Files  2.7 GB
Supported Languagesen
Model ArchitectureTransformerForCausalLM
Licensemit
Context Length2048
Model Max Length2048
Transformers Version4.48.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typebfloat16