LLM EXPLORER 59,420 MODELS INDEXED

Japanese Mistral 300M Base by ce-lery

By ce-lery · 149 downloads

Japanese Mistral 300M Base is an open-source language model by ce-lery. Features: 300m LLM, VRAM: 2.8GB, Context: 4K, Quantized, LLM Explorer Score: 0.1.

  Endpoints compatible   F32   Generated from trainer   Ggml   Gguf   Mistral   Quantized   Region:us   Safetensors   Tensorboard

Japanese Mistral 300M Base Parameters and Internals

Model Type 
text generation
Additional Notes 
Suppression of unknown word generation by using byte fallback in SentencePiece tokenizer and conversion to huggingface Tokenizers format.
Supported Languages 
Japanese (fluent)
Training Details 
Data Sources:
wikipedia, cc100
Methodology:
Pretraining with flash attention2 and torch.compile and DeepSpeed, Fine-tuning with databricks-dolly-15k-ja
Input Output 
Input Format:
tokenized input
Accepted Modalities:
text
Output Format:
tokenized output
LLM NameJapanese Mistral 300M Base
Repository πŸ€—https://huggingface.co/ce-lery/japanese-mistral-300m-base 
Base Model(s)  None   /None
Model Size300m
Required VRAM2.8 GB
Updated2026-07-07
Maintainerce-lery
Model Typemistral
Model Files  1.4 GB   1.4 GB   0.0 GB
GGML QuantizationYes
GGUF QuantizationYes
Quantization Typeggml|gguf
Model ArchitectureMistralForCausalLM
Context Length4096
Model Max Length4096
Transformers Version4.35.2
Tokenizer ClassT5Tokenizer
Padding Token[PAD]
Vocabulary Size50257
Torch Data Typefloat32

Best Alternatives to Japanese Mistral 300M Base

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 300M Base8K / 0.6 GB281
Lite Oute 1 300M Instruct4K / 1.2 GB469
Lite Oute 1 300M4K / 1.2 GB219
Mistral 300M4K / 0 GB72
...anese Mistral 300M Instruction4K / 1.4 GB33
Note: green Score (e.g. "73.2") means that the model is better than ce-lery/japanese-mistral-300m-base.