LLM EXPLORER 59,805 MODELS INDEXED

Salamandra 2B by BSC-LT

By BSC-LT · 5781 downloads
HF Repo ↗ Copy URL

Salamandra 2B is an open-source language model by BSC-LT. Features: 2b LLM, VRAM: 4.5GB, Context: 8K, License: apache-2.0, LLM Explorer Score: 0.18.

  Arxiv:1803.09010   Arxiv:1810.06694   Arxiv:1906.03741   Arxiv:1911.05507   Arxiv:2101.00027   Arxiv:2207.00220   Arxiv:2402.06619   Arxiv:2403.14009   Arxiv:2403.20266   Arxiv:2406.17557   Arxiv:2502.08489   Bg   Ca   Code   Cs   Cy   Da Dataset:ai-team-uoa/greek lega...   Dataset:allenai/pes2o   Dataset:bigcode/starcoderdata Dataset:bjoernp/tagesschau-201... Dataset:community-datasets/hrw... Dataset:danish-foundation-mode... Dataset:eleutherai/the pile de...   Dataset:hitz/euscrawl   Dataset:hitz/latxa-corpus-v1.1 Dataset:hoskinson-center/proof... Dataset:huggingfacefw/fineweb-...   Dataset:joelito/legal-mc4 Dataset:joelniklaus/eurlex res... Dataset:oscar-corpus/colossal-... Dataset:pile-of-law/pile-of-la...   Dataset:pleias/french-pd-books Dataset:pleias/french-pd-newsp...   Dataset:portulan/parlamento-pt   Dataset:projecte-aina/catalog Dataset:togethercomputer/redpa...   Dataset:ufrgs/brwac   De   Deploy:azure   El   En   Endpoints compatible   Es   Et   Eu   Fi   Fr   Ga   Gl   Hr   Hu   It   Llama   Lt   Lv   Mt   Nl   Nn   Oc   Pl   Pt   Region:us   Ro   Ru   Safetensors   Sh   Sk   Sl   Sr   Sv   Uk
Model Card on HF 🤗: https://huggingface.co/BSC-LT/salamandra-2b 

Salamandra 2B Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Research and commercial applications
Applications:
Language generation, Instruction-tuned for general-purpose assistant tasks
Primary Use Cases:
Text generation in various domains, fine-tuning for specific use-cases
Limitations:
Not intended for malicious activities, must comply with laws and regulations
Considerations:
Developers must perform safety testing and bias reduction tailored to applications.
Additional Notes 
Model trained with over-representation of certain languages and scaling challenges.
Supported Languages 
bg (Supported), ca (Supported), code (Supported), cs (Supported), cy (Supported), da (Supported), de (Supported), el (Supported), en (Supported), es (Supported), et (Supported), eu (Supported), fi (Supported), fr (Supported), ga (Supported), gl (Supported), hr (Supported), hu (Supported), it (Supported), lt (Supported), lv (Supported), mt (Supported), nl (Supported), nn (Supported), no (Supported), oc (Supported), pl (Supported), pt (Supported), ro (Supported), ru (Supported), sh (Supported), sk (Supported), sl (Supported), sr (Supported), sv (Supported), uk (Supported)
Training Details 
Data Sources:
Common Crawl, GitHub, Wikimedia, EurLex, Spanish Crawling
Data Volume:
33TB of pre-processed text (7.8 trillion tokens)
Methodology:
Transformer-based decoder-only model
Context Length:
8192
Training Time:
Training timeline not specified
Hardware Used:
MareNostrum 5
Model Architecture:
24 layers, hidden size of 2048, 16 attention heads, SwiGLU activation, RMS Norm layer normalization
Responsible Ai Considerations 
Fairness:
Bias testing using BBQ dataset in English and Regard dataset
Mitigation Strategies:
Post training phase adjustments recommended to address biases
LLM NameSalamandra 2B
Repository 🤗https://huggingface.co/BSC-LT/salamandra-2b 
Model Size2b
Required VRAM4.5 GB
Updated2026-08-29
MaintainerBSC-LT
Model Typellama
Model Files  4.5 GB
Supported Languagesbg ca code cs cy da de el en es et eu fi fr ga gl hr hu it lt lv mt nl nn oc pl pt ro ru sh sk sl sr sv uk
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size256000
Torch Data Typebfloat16

Quantized Models of the Salamandra 2B

Model
Likes
Downloads
VRAM
Aitana 2B S Base15594 GB

Best Alternatives to Salamandra 2B

Best Alternatives
Context / RAM
Downloads
Likes
Llama 2B Hf 32768 Fpf32K / 3.8 GB81
...icpm 2B Sft Bf16 Llamafied 16K16K / 6 GB5601
...de Toolcall Slm 2B Safetensors8K / 3.4 GB01
Aitana 2B SI Instruct8K / 4.5 GB520
Aitana 2B S Base IP 1.08K / 4.5 GB1860
Aitana 2B SI Instruct Aligned8K / 4.5 GB190
Aitana 2B S IP Instruct8K / 4.5 GB130
Aitana 2B S Instruct Aligned8K / 6.9 GB100
Aitana 2B S IP Base8K / 4.5 GB130
Salamandra 2B Fft Trenes8K / 4.5 GB320
Note: green Score (e.g. "73.2") means that the model is better than BSC-LT/salamandra-2b.