Japanese Mpt 7B by lightblue

 ยป  All LLMs  ยป  lightblue  ยป  Japanese Mpt 7B   URL Share it on

  Autotrain compatible   Custom code   Endpoints compatible   Mpt   Pytorch   Region:us   Sharded

Japanese Mpt 7B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Japanese Mpt 7B (lightblue/japanese-mpt-7b)
๐ŸŒŸ Advertise your project ๐Ÿš€

Japanese Mpt 7B Parameters and Internals

Model Type 
text generation
Additional Notes 
To run the model efficiently, loading in 8-bit or 4-bit precision is recommended for T4 GPUs.
Training Details 
Data Sources:
mC4 (Japanese subset)
Methodology:
Trained for 3000 steps on top of the MPT 7b checkpoint
LLM NameJapanese Mpt 7B
Repository ๐Ÿค—https://huggingface.co/lightblue/japanese-mpt-7b 
Model Size7b
Required VRAM13.3 GB
Updated2025-09-23
Maintainerlightblue
Model Typempt
Model Files  9.9 GB: 1-of-2   3.4 GB: 2-of-2
Model ArchitectureMPTForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.30.2
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50432
Torch Data Typebfloat16

Best Alternatives to Japanese Mpt 7B

Best Alternatives
Context / RAM
Downloads
Likes
Mpt 7B Chat0K / 13.3 GB80920518
Mpt 7B0K / 13.3 GB184601173
Mpt 7B Storywriter0K / 13.3 GB2261839
Mpt 7B Instruct0K / 13.3 GB7946470
Mpt 7B Int8 Ov0K / 0 GB130
Shears Mpt 7B 50 Base0K / 13.3 GB712
Mpt 7B0K / 26.5 GB51321
Mpt 7B 8K0K / 13.3 GB191526
Mpt 7B 8K Chat0K / 13.3 GB194240
Mpt 7B 8K Instruct0K / 13.3 GB201227
Note: green Score (e.g. "73.2") means that the model is better than lightblue/japanese-mpt-7b.

Rank the Japanese Mpt 7B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51534 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124