LLM EXPLORER 61,755 MODELS INDEXED

Sea Lion 3B by aisingapore

By aisingapore · 778 downloads

Sea Lion 3B is an open-source language model by aisingapore. Features: 3b LLM, VRAM: 6.4GB, License: mit, LLM Explorer Score: 0.1.

  Arxiv:2101.09635   Autotrain compatible   Custom code   En   Endpoints compatible   Id   Km   Lo   Mpt   Ms   My   Region:us   Safetensors   Ta   Th   Tl   Vi   Zh

Sea Lion 3B Parameters and Internals

Model Type 
Decoder
Additional Notes 
Model has not been aligned for safety. Users should perform their own safety fine-tuning.
Supported Languages 
en (English), zh (Chinese), id (Indonesian), ms (Malay), tl (Filipino), my (Burmese), vi (Vietnamese), th (Thai), lo (Lao), km (Khmer), ta (Tamil)
Training Details 
Data Sources:
RefinedWeb - English, mC4 - Chinese, mC4 - Indonesian, mC4 - Malay, mC4 - Filipino, mC4 - Burmese, mC4 - Vietnamese, mC4 - Thai, WangChanBERTa - Thai, mC4 - Lao, mC4 - Khmer, mC4 - Tamil, the Stack - Python, the Stack - Javascript, the Stack - Shell, the Stack - SQL, the Stack - Markdown, RedPajama - StackExchange, RedPajama - ArXiv
Data Volume:
980B tokens
Methodology:
Pretrained and instruct-tuned for SEA region
Context Length:
2048
Training Time:
14 days
Hardware Used:
AWS EC2 p4d.24xlarge, Nvidia A100 40GB GPU
Model Architecture:
MPT architecture
LLM NameSea Lion 3B
Repository πŸ€—https://huggingface.co/aisingapore/sea-lion-3b 
Model Size3b
Required VRAM6.4 GB
Updated2025-04-13
Maintaineraisingapore
Model Typempt
Model Files  6.4 GB
Supported Languagesen zh id ms tl my vi th lo km ta
Model ArchitectureMPTForCausalLM
Licensemit
Transformers Version4.34.1
Tokenizer ClassSEABPETokenizer
Vocabulary Size256000
Torch Data Typebfloat16

Best Alternatives to Sea Lion 3B

Best Alternatives
Context / RAM
Downloads
Likes
Replit Code V1.5 3B0K / 6.6 GB544316
Code Millenials 3B0K / 5.2 GB51
SEA LION V1 3B0K / 6.4 GB18619
Mpt 3B 8K Instruct0K / 6.9 GB53
Replit Code V1 3B0K / 10.4 GB111744
Glaive Function Calling V10K / 10.4 GB875
...aive Function Calling V2 Small0K / 10.4 GB815
Evol Replit V10K / 10.4 GB98
Replit V2 CodeInstruct 3B0K / 10.4 GB1771
Replit CodeInstruct V30K / 10.4 GB72
Note: green Score (e.g. "73.2") means that the model is better than aisingapore/sea-lion-3b.