Retnet 1.3B 100B is an open-source language model by fla-hub. Features: 100b LLM, VRAM: 2.7GB, Context: 2K, License: mit, LLM Explorer Score: 0.12.
| Model Type |
|
| LLM Name | Retnet 1.3B 100B |
| Repository 🤗 | https://huggingface.co/fla-hub/retnet-1.3B-100B |
| Model Size | 100b |
| Required VRAM | 2.7 GB |
| Updated | 2026-08-07 |
| Maintainer | fla-hub |
| Model Type | retnet |
| Model Files | |
| Supported Languages | en |
| Model Architecture | RetNetForCausalLM |
| License | mit |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.48.2 |
| Tokenizer Class | LlamaTokenizer |
| Vocabulary Size | 32000 |
| Torch Data Type | bfloat16 |