What are the hardware requirements for Bloomz 560M Sft Chat?

Bloomz 560M Sft Chat requires approximately 1.1 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Bloomz 560M Sft Chat and how large is it?

Bloomz 560M Sft Chat is developed by cmarkea, a model with 560m parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Bloomz 560M Sft Chat perform on standard benchmarks?

Bloomz 560M Sft Chat has the following published scores: MMLU 23.93. Compare against reference models on this page or on the LLM Explorer leaderboards.

Bloomz 560M Sft Chat by cmarkea — VRAM 1.1GB

Name: Bloomz 560M Sft Chat
Author: cmarkea

Bloomz 560M Sft Chat is an open-source language model by cmarkea. Features: 560m LLM, VRAM: 1.1GB, License: bigscience-bloom-rail-1.0, LLM Explorer Score: 0.13, Arc: 27.5, HellaSwag: 37.1, MMLU: 23.9.

Arxiv:2001.09977 Arxiv:2012.15613 Bloom Dataset:ehartford/wizard vicun... Dataset:laion/oig Dataset:shahules786/orca-chat Dataset:timdettmers/openassist... En Endpoints compatible Fr Pytorch Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/cmarkea/bloomz-560m-sft-chat

Bloomz 560M Sft Chat Parameters and Internals

Model Type

text generation

Use Cases

Areas:

research, commercial applications

Primary Use Cases:

chatbot applications

Limitations:

Performance not guaranteed in languages other than French and English, Possibly reduced multilingual capabilities due to transposition from float16 to bfloat16

Considerations:

It's been tuned in a chatbot context and performs well on zero-shot tasks in English and French.

Additional Notes

Performance degradation anticipated in non-supported languages.

Supported Languages

French (High proficiency), English (High proficiency)

Training Details

Data Sources:

ehartford/wizard_vicuna_70k_unfiltered, shahules7876/orca-chat, timdettmers/openassistant-guanaco, laion/OIG

Data Volume:

0.9 billion tokens

Methodology:

fine-tuned for chatbot applications from BigScience BLOOMZ-560m

Training Time:

41 hours

Hardware Used:

1 x A100 40GB

Model Architecture:

Transposition from float16 to bfloat16

Input Output

Input Format:

Individual's prompt preceded by the EOS token (</s>).

Accepted Modalities:

text

Output Format:

Generated responses begin with BOS token (<s>).

Release Notes

Version:

2023

Date:

October 12, 2023

Notes:

Release of bloomz-560m-sft-chat model, optimized for chat and instruction-based tasks in French and English.

LLM Name	Bloomz 560M Sft Chat
Repository 🤗	https://huggingface.co/cmarkea/bloomz-560m-sft-chat
Model Size	560m
Required VRAM	1.1 GB
Updated	2026-07-11
Maintainer	cmarkea
Model Type	bloom
Model Files	1.1 GB 1.1 GB
Supported Languages	fr en
Model Architecture	BloomForCausalLM
License	bigscience-bloom-rail-1.0
Transformers Version	4.31.0
Tokenizer Class	BloomTokenizer
Padding Token	<pad>
Vocabulary Size	250880
Torch Data Type	bfloat16

Rank the Bloomz 560M Sft Chat capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Bloomz 560M Sft Chat

Best Alternatives	Context / RAM	Downloads	Likes
Bloomz 560M	0K / 1.1 GB	1150613	137
Bloom 560M	0K / 1.1 GB	608345	375
Train Test Bloom560	0K / 2.2 GB	14	0
Bloom 560M RLHF V2	0K / 1.1 GB	504	3
Bloom 560M RLHF	0K / 1.1 GB	499	1
Promt Generator	0K / 2.2 GB	930	43
Train Test	0K / 2.2 GB	30	0
Product Description Fr	0K / 2.2 GB	7	0
Guitester	0K / 2.2 GB	5	0
ModeloAJustadoBloom1	0K / 2.2 GB	10	0

Note: green Score (e.g. "73.2") means that the model is better than cmarkea/bloomz-560m-sft-chat.