LLM EXPLORER 59,420 MODELS INDEXED

Falcon3 7B Instruct 1.58bit by tiiuae

By tiiuae · 1714 downloads

Falcon3 7B Instruct 1.58bit is an open-source language model by tiiuae. Features: 7b LLM, VRAM: 3.3GB, Context: 32K, License: other, Instruction-Based, LLM Explorer Score: 0.17.

  Arxiv:2402.17764   8-bit Base model:quantized:tiiuae/fa... Base model:tiiuae/falcon3-7b-i...   Bitnet   Conversational   Deploy:azure   Endpoints compatible   Falcon3   Instruct   Llama   Region:us   Safetensors

Falcon3 7B Instruct 1.58bit Parameters and Internals

LLM NameFalcon3 7B Instruct 1.58bit
Repository πŸ€—https://huggingface.co/tiiuae/Falcon3-7B-Instruct-1.58bit 
Base Model(s)  Falcon3 7B Instruct   tiiuae/Falcon3-7B-Instruct
Model Size7b
Required VRAM3.3 GB
Updated2026-07-31
Maintainertiiuae
Model Typellama
Instruction-BasedYes
Model Files  3.3 GB
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.46.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|pad|>
Vocabulary Size131080
Torch Data Typebfloat16

Best Alternatives to Falcon3 7B Instruct 1.58bit

Best Alternatives
Context / RAM
Downloads
Likes
1241024K / 16.1 GB930
A5.41024K / 16.1 GB120
A3.41024K / 16.1 GB130
A2.41024K / 16.1 GB120
... Qwen2.5llamaify 7B V23.1 200K195K / 15.2 GB295
Salamandra 7B Instruct 2606160K / 15.6 GB9272
SuperNeuralDreadDevil 8B128K / 16.1 GB141
Falcon3 7B Instruct32K / 14.8 GB1174980
Falcon3 Jessi V0.4 7B Slerp32K / 14.9 GB349
Jessi V0.4 Falcon3 7B Instruct32K / 14.8 GB220
Note: green Score (e.g. "73.2") means that the model is better than tiiuae/Falcon3-7B-Instruct-1.58bit.