Model Type |
| ||||||||||||
Additional Notes |
| ||||||||||||
Supported Languages |
| ||||||||||||
Training Details |
| ||||||||||||
Input Output |
|
LLM Name | Sea Lion 7B Instruct Gptq |
Repository ๐ค | https://huggingface.co/aisingapore/sea-lion-7b-instruct-gptq |
Base Model(s) | |
Model Size | 7b |
Required VRAM | 5.5 GB |
Updated | 2025-04-02 |
Maintainer | aisingapore |
Model Type | mpt |
Instruction-Based | Yes |
Model Files | |
Supported Languages | en zh id vi ms tl my th lo km ta |
GPTQ Quantization | Yes |
Quantization Type | gptq|4bit |
Model Architecture | MPTForCausalLM |
License | mit |
Transformers Version | 4.38.2 |
Tokenizer Class | SEABPETokenizer |
Padding Token | <|padding|> |
Vocabulary Size | 256000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
SEA LION V1 7B IT GPTQ | 0K / 5.5 GB | 27 | 0 |
SEA LION V1 7B IT GBTQ | 0K / 5.5 GB | 7 | 0 |
Mpt 7B 8K Chat Gptq | 0K / 3.8 GB | 55 | 2 |
Mpt 7B Chat Q8 | 0K / 6.9 GB | 35 | 1 |
Mpt 7B Instruct Q8 | 0K / 6.9 GB | 19 | 2 |
Mpt 7B Chat | 0K / 13.3 GB | 84546 | 514 |
Mpt 7B Instruct | 0K / 13.3 GB | 8695 | 470 |
Mpt 7B Int8 Ov | 0K / 0 GB | 20 | 0 |
Sea Lion 7B Instruct | 0K / 15 GB | 208 | 23 |
Mpt 7B 8K Instruct | 0K / 13.3 GB | 615 | 26 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐