LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  Agents   Benchmarks   LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Salamandra 2B by BSC-LT

 »  All LLMs  »  BSC-LT  »  Salamandra 2B   URL Share it on

  556   

Salamandra 2B is an open-source language model by BSC-LT. Features: 2b LLM, VRAM: 4.5GB, Context: 8K, License: apache-2.0, LLM Explorer Score: 0.16.

  Arxiv:1803.09010   Arxiv:1810.06694   Arxiv:1906.03741   Arxiv:1911.05507   Arxiv:2101.00027   Arxiv:2207.00220   Arxiv:2402.06619   Arxiv:2403.14009   Arxiv:2403.20266   Arxiv:2406.17557   Arxiv:2502.08489   Bg   Ca   Code   Cs   Cy   Da Dataset:ai-team-uoa/greek lega...   Dataset:allenai/pes2o   Dataset:bigcode/starcoderdata Dataset:bjoernp/tagesschau-201... Dataset:community-datasets/hrw... Dataset:danish-foundation-mode... Dataset:eleutherai/the pile de...   Dataset:hitz/euscrawl   Dataset:hitz/latxa-corpus-v1.1 Dataset:hoskinson-center/proof... Dataset:huggingfacefw/fineweb-...   Dataset:joelito/legal-mc4 Dataset:joelniklaus/eurlex res... Dataset:oscar-corpus/colossal-... Dataset:pile-of-law/pile-of-la...   Dataset:pleias/french-pd-books Dataset:pleias/french-pd-newsp...   Dataset:portulan/parlamento-pt   Dataset:projecte-aina/catalog Dataset:togethercomputer/redpa...   Dataset:ufrgs/brwac   De   Deploy:azure   El   En   Endpoints compatible   Es   Et   Eu   Fi   Fr   Ga   Gl   Hr   Hu   It   Llama   Lt   Lv   Mt   Nl   Nn   Oc   Pl   Pt   Region:us   Ro   Ru   Safetensors   Sh   Sk   Sl   Sr   Sv   Uk
Model Card on HF 🤗: https://huggingface.co/BSC-LT/salamandra-2b 

Salamandra 2B Benchmarks

LLME Score: 0.15803
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Salamandra 2B (BSC-LT/salamandra-2b)
🌟 Advertise your project 🚀

Salamandra 2B Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Research and commercial applications
Applications:
Language generation, Instruction-tuned for general-purpose assistant tasks
Primary Use Cases:
Text generation in various domains, fine-tuning for specific use-cases
Limitations:
Not intended for malicious activities, must comply with laws and regulations
Considerations:
Developers must perform safety testing and bias reduction tailored to applications.
Additional Notes 
Model trained with over-representation of certain languages and scaling challenges.
Supported Languages 
bg (Supported), ca (Supported), code (Supported), cs (Supported), cy (Supported), da (Supported), de (Supported), el (Supported), en (Supported), es (Supported), et (Supported), eu (Supported), fi (Supported), fr (Supported), ga (Supported), gl (Supported), hr (Supported), hu (Supported), it (Supported), lt (Supported), lv (Supported), mt (Supported), nl (Supported), nn (Supported), no (Supported), oc (Supported), pl (Supported), pt (Supported), ro (Supported), ru (Supported), sh (Supported), sk (Supported), sl (Supported), sr (Supported), sv (Supported), uk (Supported)
Training Details 
Data Sources:
Common Crawl, GitHub, Wikimedia, EurLex, Spanish Crawling
Data Volume:
33TB of pre-processed text (7.8 trillion tokens)
Methodology:
Transformer-based decoder-only model
Context Length:
8192
Training Time:
Training timeline not specified
Hardware Used:
MareNostrum 5
Model Architecture:
24 layers, hidden size of 2048, 16 attention heads, SwiGLU activation, RMS Norm layer normalization
Responsible Ai Considerations 
Fairness:
Bias testing using BBQ dataset in English and Regard dataset
Mitigation Strategies:
Post training phase adjustments recommended to address biases
LLM NameSalamandra 2B
Repository 🤗https://huggingface.co/BSC-LT/salamandra-2b 
Model Size2b
Required VRAM4.5 GB
Updated2026-07-05
MaintainerBSC-LT
Model Typellama
Model Files  4.5 GB
Supported Languagesbg ca code cs cy da de el en es et eu fi fr ga gl hr hu it lt lv mt nl nn oc pl pt ro ru sh sk sl sr sv uk
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size256000
Torch Data Typebfloat16

Quantized Models of the Salamandra 2B

Model
Likes
Downloads
VRAM
Aitana 2B S Base02714 GB

Best Alternatives to Salamandra 2B

Best Alternatives
Context / RAM
Downloads
Likes
Llama 2B Hf 32768 Fpf32K / 3.8 GB91
...icpm 2B Sft Bf16 Llamafied 16K16K / 6 GB5601
Aitana 2B S IP Instruct8K / 4.5 GB670
Aitana 2B S Instruct Aligned8K / 6.9 GB1000
Aitana 2B SI Instruct Aligned8K / 4.5 GB390
Aitana 2B S Base IP 1.08K / 4.5 GB1860
Aitana 2B SI Instruct8K / 4.5 GB220
Aitana 2B S IP Base8K / 4.5 GB160
Salamandra 2B Fft Trenes8K / 4.5 GB320
SmolLM2 MedIT Upscale 2B8K / 4.2 GB65
Note: green Score (e.g. "73.2") means that the model is better than BSC-LT/salamandra-2b.

Rank the Salamandra 2B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 55114 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a
  Support LLM Explorer