LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Modello Italia 9B Autoround W4g128 Cpu by fbaldassarri

 »  All LLMs  »  fbaldassarri  »  Modello Italia 9B Autoround W4g128 Cpu   URL Share it on

  31   
  Arxiv:2309.05516   4-bit   Autotrain compatible   Conversational   Endpoints compatible   Gpt neox   Gptq   It   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-cpu 

Modello Italia 9B Autoround W4g128 Cpu Benchmarks

LLME Score: 0.17738
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
🌟 Advertise your project 🚀

Modello Italia 9B Autoround W4g128 Cpu Parameters and Internals

Model Type 
Large Language Model
Use Cases 
Areas:
Research, Commercial Applications
Primary Use Cases:
General language tasks in Italian
Limitations:
Potentially biased content, Not thoroughly tested for every situation
Additional Notes 
The model was converted and optimized for CPU inference using INT4 quantization and group-size 128. Based on GPT-NeoX architecture.
Supported Languages 
it (Italian)
Safety Evaluation 
Risk Categories:
Bias
Ethical Considerations:
The model recognizes the potential for bias and problematic content inherent in large language models, reflecting imbalances in the training data.
Responsible Ai Considerations 
Fairness:
Modello Italia is intended for a diverse range of use cases, aiming to be accessible without bias. However, users should conduct their safety and adaptation testing.
Mitigation Strategies:
Users are encouraged to perform specific safety and adaptation tests for their applications.
LLM NameModello Italia 9B Autoround W4g128 Cpu
Repository 🤗https://huggingface.co/fbaldassarri/modello-italia-9b-autoround-w4g128-cpu 
Model Size9b
Required VRAM5.2 GB
Updated2025-06-09
Maintainerfbaldassarri
Model Typegpt_neox
Model Files  4.7 GB: 1-of-2   0.5 GB: 2-of-2
Supported Languagesit
Model ArchitectureGPTNeoXForCausalLM
Licensemit
Context Length4096
Model Max Length4096
Transformers Version4.41.0
Tokenizer ClassLlamaTokenizer
Vocabulary Size50176
Torch Data Typefloat16
Modello Italia 9B Autoround W4g128 Cpu (fbaldassarri/modello-italia-9b-autoround-w4g128-cpu)

Best Alternatives to Modello Italia 9B Autoround W4g128 Cpu

Best Alternatives
Context / RAM
Downloads
Likes
Modello Italia 9B4K / 34 GB346019
Modello Italia 9B Bf164K / 17.1 GB339910
...Italia 9B Autoround W4g128 Gpu4K / 5.2 GB80
Modello Italia 9B Hf4K / 17.1 GB152
H2ogpt Oig Oasst1 512 6 9b2K / 13.8 GB118518
Archangel Sft Pythia6 9B2K / 13.8 GB230
Hi NOLIN 9B2K / 19.5 GB276
H2ogpt Oig Oasst1 256 6 9b2K / 13.8 GB1955
Note: green Score (e.g. "73.2") means that the model is better than fbaldassarri/modello-italia-9b-autoround-w4g128-cpu.

Rank the Modello Italia 9B Autoround W4g128 Cpu Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48046 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer