Ak Ar As Bm Bn Ca Code En Endpoints compatible Es Eu Fon Fr Ggml Gu Hi Id Ig Ki Kn Lg Llm-rs Ln Ml Mr Ne Nso Ny Or Pa Pt Q4 Q4 0 Quantized Region:us Rn Rw Sn St Sw Ta Te Tn Ts Tum Tw Ur Vi Wo Xh Yo Zh Zu
Model Card on HF 🤗: https://huggingface.co/rustformers/bloom-ggml
Bloom GGML Benchmarks
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
What is the LLM Explorer Rank (Score)
Bloom GGML Parameters and Internals
| Model Type |
| |||||||||
| Use Cases |
| |||||||||
| Additional Notes |
| |||||||||
| Supported Languages |
| |||||||||
| Training Details |
|
| LLM Name | Bloom GGML |
| Repository 🤗 | https://huggingface.co/rustformers/bloom-ggml |
| Model Size | 3b |
| Required VRAM | 0.5 GB |
| Updated | 2025-08-23 |
| Maintainer | rustformers |
| Model Files | |
| Supported Languages | ak ar as bm bn ca code en es eu fr gu hi id ig ki kn lg ln ml mr ne ny or pa pt rn rw sn st sw ta te tn ts tw ur vi wo xh yo zh zu |
| GGML Quantization | Yes |
| Quantization Type | ggml|q4|q4_0|q5_1 |
| Model Architecture | AutoModel |
| License | bigscience-bloom-rail-1.0 |
Best Alternatives to Bloom GGML
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Marx 3B GGML | 0K / 1.9 GB | 5 | 7 |
| Griffin 3B GGML | 0K / 1.9 GB | 2 | 6 |
| Puma 3B GGML | 0K / 1.9 GB | 2 | 3 |
| ...blecode Instruct Alpha 3B GGML | 0K / 1.6 GB | 4 | 43 |
| ...de Completion Alpha 3B 4K GGML | 0K / 1.6 GB | 3 | 23 |
| Open Llama GGML | 0K / 1.9 GB | 4 | 9 |
| Bloomz GGML | 0K / 0.5 GB | 8 | 6 |
| Stablelm GGML | 0K / 2 GB | 3 | 3 |
| Redpajama 3B GGML | 0K / 1.6 GB | 4 | 8 |
| Diraya 3B Instruct Ar | 0K / 0 GB | 5 | 3 |
Note: green Score (e.g. "73.2") means that the model is better than rustformers/bloom-ggml .
Rank the Bloom GGML Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 50836 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124