LLM EXPLORER 59,358 MODELS INDEXED

Llama3 8B Cpt Sea Lionv2 Base by aisingapore

By aisingapore · 18 downloads

Llama3 8B Cpt Sea Lionv2 Base is an open-source language model by aisingapore. Features: 8b LLM, VRAM: 16.1GB, Context: 8K, License: llama3, Instruction-Based, LLM Explorer Score: 0.14.

  Arxiv:2101.09635   Arxiv:2309.06085   Autotrain compatible Base model:finetune:meta-llama... Base model:meta-llama/meta-lla...   En   Endpoints compatible   Id   Instruct   Llama   Region:us   Safetensors   Sharded   Ta   Tensorflow   Th   Vi

Llama3 8B Cpt Sea Lionv2 Base Parameters and Internals

Model Type 
Decoder
Additional Notes 
The model has not been aligned for safety. Developers and users should perform their own safety fine-tuning and related security measures.
Supported Languages 
en (English), id (Indonesian), th (Thai), vi (Vietnamese), ta (Tamil)
Training Details 
Data Sources:
Dolma RefinedWeb - English, Dolma C4 - English, Dolma Reddit - English, Dolma Semantic Scholar, Dolma arXiv, Dolma StarCoder, SEA-LION Pile - Indonesian, Wiki* - Indonesian, SEA-LION Pile - Tamil, Wiki* + News - Tamil, SEA-LION Pile - Thai, WangChanBERTa - Thai, Wiki* - Thai, SEA-LION Pile - Vietnamese, Wiki* - Vietnamese
Data Volume:
48 billion tokens
Methodology:
Continued pre-training from Meta-Llama-3-8B-Instruct
Training Time:
2 days
Hardware Used:
AWS EC2 p5d.24xlarge instances - 8, Nvidia H100 80GB GPU - 64
LLM NameLlama3 8B Cpt Sea Lionv2 Base
Repository πŸ€—https://huggingface.co/aisingapore/llama3-8b-cpt-sea-lionv2-base 
Base Model(s)  Meta Llama 3 8B Instruct   meta-llama/Meta-Llama-3-8B-Instruct
Model Size8b
Required VRAM16.1 GB
Updated2025-04-13
Maintaineraisingapore
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagesen id ta th vi
Model ArchitectureLlamaForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.42.3
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to Llama3 8B Cpt Sea Lionv2 Base

Best Alternatives
Context / RAM
Downloads
Likes
...otron 8B UltraLong 4M Instruct4192K / 32.1 GB1135125
UltraLong Thinking4192K / 16.1 GB23
...a 3.1 8B UltraLong 4M Instruct4192K / 32.1 GB17624
...a 3.1 8B UltraLong 2M Instruct2096K / 32.1 GB8759
...otron 8B UltraLong 2M Instruct2096K / 32.1 GB12418
Cthulhu 8B V1.41048K / 16.1 GB1010
...raLong 1M Instruct Abliterated1048K / 32.1 GB49
...a 3.1 8B UltraLong 1M Instruct1048K / 32.1 GB138729
...otron 8B UltraLong 1M Instruct1048K / 32.1 GB70259
Zero Llama 3.1 8B Beta61048K / 16.1 GB71
Note: green Score (e.g. "73.2") means that the model is better than aisingapore/llama3-8b-cpt-sea-lionv2-base.