Arxiv:2211.01786 Ak Ar As Bm Bn Ca Code Dataset:bigscience/xp3 En Endpoints compatible Es Eu Fon Fr Ggml Gu Hi Id Ig Ki Kn Lg Llm-rs Ln Ml Mr Ne Nso Ny Or Pa Pt Q4 Q4 0 Quantized Region:us Rn Rw Sn St Sw Ta Te Tn Ts Tum Tw Ur Vi Wo Xh Yo Zh Zu
Model Card on HF 🤗: https://huggingface.co/rustformers/bloomz-ggml
Bloomz GGML Benchmarks
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Bloomz GGML Parameters and Internals
| LLM Name | Bloomz GGML |
| Repository 🤗 | https://huggingface.co/rustformers/bloomz-ggml |
| Model Size | 3b |
| Required VRAM | 0.5 GB |
| Updated | 2025-08-23 |
| Maintainer | rustformers |
| Model Files | |
| Supported Languages | ak ar as bm bn ca code en es eu fr gu hi id ig ki kn lg ln ml mr ne ny or pa pt rn rw sn st sw ta te tn ts tw ur vi wo xh yo zh zu |
| GGML Quantization | Yes |
| Quantization Type | ggml|q4|q4_0|q5_1 |
| Model Architecture | AutoModel |
| License | bigscience-bloom-rail-1.0 |
Best Alternatives to Bloomz GGML
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Marx 3B GGML | 0K / 1.9 GB | 5 | 7 |
| Griffin 3B GGML | 0K / 1.9 GB | 2 | 6 |
| Puma 3B GGML | 0K / 1.9 GB | 2 | 3 |
| ...blecode Instruct Alpha 3B GGML | 0K / 1.6 GB | 4 | 43 |
| ...de Completion Alpha 3B 4K GGML | 0K / 1.6 GB | 3 | 23 |
| Open Llama GGML | 0K / 1.9 GB | 4 | 9 |
| Stablelm GGML | 0K / 2 GB | 3 | 3 |
| Bloom GGML | 0K / 0.5 GB | 14 | 8 |
| Redpajama 3B GGML | 0K / 1.6 GB | 4 | 8 |
| Diraya 3B Instruct Ar | 0K / 0 GB | 5 | 3 |
Note: green Score (e.g. "73.2") means that the model is better than rustformers/bloomz-ggml .
Rank the Bloomz GGML Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 50836 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124