LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  Agents   Benchmarks   LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Modello Italia 9B Autoround W4g128 Gpu by fbaldassarri

 »  All LLMs  »  fbaldassarri  »  Modello Italia 9B Autoround W4g128 Gpu   URL Share it on

  6   

Modello Italia 9B Autoround W4g128 Gpu is an open-source language model by fbaldassarri. Features: 9b LLM, VRAM: 5.2GB, Context: 4K, License: mit, LLM Explorer Score: 0.15.

  Arxiv:2309.05516   4-bit   Autotrain compatible   Conversational   Endpoints compatible   Gpt neox   Gptq   It   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-gpu 

Modello Italia 9B Autoround W4g128 Gpu Benchmarks

LLME Score: 0.15014
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Modello Italia 9B Autoround W4g128 Gpu (fbaldassarri/modello-italia-9b-autoround-w4g128-gpu)
🌟 Advertise your project 🚀

Modello Italia 9B Autoround W4g128 Gpu Parameters and Internals

Model Type 
Large Language Model
Use Cases 
Areas:
Commercial applications, Research
Limitations:
Possibility of generating inaccurate, biased or other problematic responses
Additional Notes 
The model has been unofficially quantized for optimization using Intel auto-round.
Supported Languages 
Italian (Proficient), English (Unknown)
Training Details 
Methodology:
Quantized in INT4, optimized for GPUs.
Model Architecture:
GPT-NeoX
Responsible Ai Considerations 
Fairness:
The model attempts to be inclusive for a wide range of use-cases without inserting superfluous judgments.
Mitigation Strategies:
Developers are encouraged to run safety tests specific to their applications.
LLM NameModello Italia 9B Autoround W4g128 Gpu
Repository 🤗https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-gpu 
Model Size9b
Required VRAM5.2 GB
Updated2025-09-23
Maintainerfbaldassarri
Model Typegpt_neox
Model Files  5.2 GB
Supported Languagesit
Model ArchitectureGPTNeoXForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size50176
Torch Data Typefloat32

Best Alternatives to Modello Italia 9B Autoround W4g128 Gpu

Best Alternatives
Context / RAM
Downloads
Likes
Modello Italia 9B Bf164K / 17.1 GB194610
Modello Italia 9B4K / 34 GB123819
...Italia 9B Autoround W4g128 Cpu4K / 5.2 GB50
Modello Italia 9B Hf4K / 17.1 GB32
H2ogpt Oig Oasst1 512 6 9b2K / 13.8 GB962318
H2ogpt Oig Oasst1 256 6 9b2K / 13.8 GB10405
Archangel Sft Pythia6 9B2K / 13.8 GB70
Hi NOLIN 9B2K / 19.5 GB06
Note: green Score (e.g. "73.2") means that the model is better than fbaldassarri/modello-italia-9b-autoround-w4g128-gpu.

Rank the Modello Italia 9B Autoround W4g128 Gpu Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51648 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260327b
  Support LLM Explorer