LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

OpenAssistant Falcon 40B 4 Bits Autogptq by flozi00

 »  All LLMs  »  flozi00  »  OpenAssistant Falcon 40B 4 Bits Autogptq   URL Share it on

  7   
  Autogptq   Autotrain compatible   Dataset:openassistant/oasst1   De   En   Endpoints compatible   Es   Fr   Refinedweb   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/flozi00/OpenAssistant-falcon-40B-4-bits-autogptq 

OpenAssistant Falcon 40B 4 Bits Autogptq Benchmarks

LLME Score: 0.08754
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
OpenAssistant Falcon 40B 4 Bits Autogptq (flozi00/OpenAssistant-falcon-40B-4-bits-autogptq)
🌟 Advertise your project 🚀

OpenAssistant Falcon 40B 4 Bits Autogptq Parameters and Internals

Supported Languages 
languages_supported (de, en, fr, es), proficiency_level (unspecified)
LLM NameOpenAssistant Falcon 40B 4 Bits Autogptq
Repository 🤗https://huggingface.co/flozi00/OpenAssistant-falcon-40B-4-bits-autogptq 
Model Size40b
Required VRAM23.3 GB
Updated2025-10-07
Maintainerflozi00
Model TypeRefinedWeb
Model Files  23.3 GB
Supported Languagesde en fr es
Model ArchitectureRWForCausalLM
Model Max Length2048
Transformers Version4.30.0.dev0
Is Biased0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size65040
Torch Data Typefloat16

Best Alternatives to OpenAssistant Falcon 40B 4 Bits Autogptq

Best Alternatives
Context / RAM
Downloads
Likes
Alfred 40B 10230K / 83.6 GB180548
Vulture 40B0K / 81.8 GB8258
Docsgpt 40B Falcon0K / 82.5 GB613
Alfred 40B 07230K / 83.6 GB946
Openbuddy Falcon 40B V9 Bf160K / 82.6 GB54
...m Oasst1 En 2048 Falcon 40B V20K / 83.6 GB18218
...alcon 40B Lora Sft Stage2 1.1K0K / 82.5 GB60
Falcon 40B0K / 83.6 GB81
...m Oasst1 En 2048 Falcon 40B V10K / 165 GB18331
Falcon 40B Sft Top1 5600K / 83.6 GB10750
Note: green Score (e.g. "73.2") means that the model is better than flozi00/OpenAssistant-falcon-40B-4-bits-autogptq.

Rank the OpenAssistant Falcon 40B 4 Bits Autogptq Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51545 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer