Falcon 180B GGUF by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Falcon 180B GGUF   URL Share it on

  Arxiv:1911.02150   Arxiv:2005.14165   Arxiv:2101.00027   Arxiv:2104.09864   Arxiv:2205.14135   Arxiv:2306.01116 Base model:finetune:tiiuae/fal...   Base model:tiiuae/falcon-180b Dataset:tiiuae/falcon-refinedw...   De   En   Es   Falcon   Fr   Gguf   Quantized   Region:us

Falcon 180B GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Falcon 180B GGUF (TheBloke/Falcon-180B-GGUF)
๐ŸŒŸ Advertise your project ๐Ÿš€

Falcon 180B GGUF Parameters and Internals

Model Type 
falcon, causal decoder-only
Use Cases 
Primary Use Cases:
Research, Foundation for specialization and finetuning
Limitations:
Production use without adequate assessment may be harmful.
Supported Languages 
English (high), German (high), Spanish (high), French (high), Italian (limited), Portuguese (limited), Polish (limited), Dutch (limited), Romanian (limited), Czech (limited), Swedish (limited)
Training Details 
Data Sources:
RefinedWeb, Books, Conversations, Code, Technical, RefinedWeb-Europe
Data Volume:
3500B tokens
Methodology:
Causal language modeling
Context Length:
2048
Training Time:
Early 2023 onwards
Hardware Used:
Up to 4,096 A100 40GB GPUs
Model Architecture:
Causal decoder-only model with rotary positional embeddings, multiquery and FlashAttention
Input Output 
Accepted Modalities:
text
LLM NameFalcon 180B GGUF
Repository ๐Ÿค—https://huggingface.co/TheBloke/Falcon-180B-GGUF 
Model NameFalcon 180B
Model CreatorTechnology Innovation Institute
Base Model(s)  Falcon 180B   tiiuae/falcon-180B
Model Size180b
Updated2025-08-20
MaintainerTheBloke
Model Typefalcon
Supported Languagesen de es fr
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseunknown

Best Alternatives to Falcon 180B GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Falcon 180B Chat GGUF0K /  GB26124
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Falcon-180B-GGUF.

Rank the Falcon 180B GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 50767 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124