Falcon3 3B Base 1.58bit by tiiuae

 ยป  All LLMs  ยป  tiiuae  ยป  Falcon3 3B Base 1.58bit   URL Share it on

  Arxiv:2402.17764   Autotrain compatible Base model:quantized:tiiuae/fa... Base model:tiiuae/falcon3-3b-b...   Bitnet   Endpoints compatible   Falcon3   Llama   Region:us   Safetensors

Falcon3 3B Base 1.58bit Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
๐ŸŒŸ Advertise your project ๐Ÿš€

Falcon3 3B Base 1.58bit Parameters and Internals

LLM NameFalcon3 3B Base 1.58bit
Repository ๐Ÿค—https://huggingface.co/tiiuae/Falcon3-3B-Base-1.58bit 
Base Model(s)  Falcon3 3B Base   tiiuae/Falcon3-3B-Base
Model Size3b
Required VRAM2.2 GB
Updated2025-06-09
Maintainertiiuae
Model Typellama
Model Files  2.2 GB
Model ArchitectureLlamaForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.46.0.dev0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size131072
Torch Data Typebfloat16
Falcon3 3B Base 1.58bit (tiiuae/Falcon3-3B-Base-1.58bit)

Best Alternatives to Falcon3 3B Base 1.58bit

Best Alternatives
Context / RAM
Downloads
Likes
ISA 03 Mini 3B Hybrid Preview256K / 6.5 GB4913
Llama 3.2 3B Instruct128K / 6.5 GB15180021505
Llama 3.2 3B128K / 6.5 GB285902574
Hermes 3 Llama 3.2 3B128K / 6.5 GB43292159
DeepSeek R1 Distill Llama 3B128K / 6.5 GB94713
Cogito V1 Preview Llama 3B128K / 7.2 GB268395
Orpheus 3B 0.1 Ft128K / 6.6 GB214883
Calme 3.1 Llamaloi 3B128K / 10.6 GB35511
Orpheus 3B 0.1 Pretrained128K / 6.6 GB104510
Llama 3.2 3B Instruct128K / 6.5 GB21505466
Note: green Score (e.g. "73.2") means that the model is better than tiiuae/Falcon3-3B-Base-1.58bit.

Rank the Falcon3 3B Base 1.58bit Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48046 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124