LLM EXPLORER 63,407 MODELS INDEXED

Longcat 10.7B by SanjiWatsuki

By SanjiWatsuki · 8 downloads

Longcat 10.7B is an open-source language model by SanjiWatsuki. Features: 10.7b LLM, VRAM: 21.5GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.11, Arc: 64.6, HellaSwag: 85.9, MMLU: 61.8, GSM8K: 46.1.

Base model:finetune:rishiraj/c... Base model:rishiraj/catppt-bas...   En   Endpoints compatible   Merge   Mistral   Region:us   Safetensors   Sharded   Tensorflow

Longcat 10.7B Parameters and Internals

Model Type 
merge, Interwoven Depth Up-Scaling, Mistral-7B
Additional Notes 
Do not attempt to merge with other 10.7Bs due to layer mismatch. Developed with humor referring to creating a 'longcat'.
Supported Languages 
en (full)
Training Details 
Methodology:
Merging using a new process called Interwoven Depth Up-Scaling
Model Architecture:
Mistral architecture with Interwoven Depth Up-Scaling
LLM NameLongcat 10.7B
Repository πŸ€—https://huggingface.co/SanjiWatsuki/longcat-10.7B 
Base Model(s)  CatPPT Base   rishiraj/CatPPT-base
Model Size10.7b
Required VRAM21.5 GB
Updated2026-07-30
MaintainerSanjiWatsuki
Model Typemistral
Model Files  10.0 GB: 1-of-3   10.0 GB: 2-of-3   1.5 GB: 3-of-3
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.36.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Longcat 10.7B

Best Alternatives
Context / RAM
Downloads
Likes
Barely Regal 10.7B32K / 21.5 GB190
Quintellect 10.7B32K / 21.4 GB223
Chikuma 10.7B32K / 21.4 GB1315
PiVoT 10.7B Mistral V0.232K / 21.4 GB765
Multi Verse Model 10.7B32K / 21.5 GB21
PrimaSumika 10.7B 128K32K / 21.5 GB31
... Loyal Mistral Maid 32K V0.2 A32K / 21.5 GB31
Chikuma 10.7B V232K / 21.4 GB100
PiVoT 10.7B Mistral V0.2 RP32K / 21.4 GB677
Mark1 Revision 10.7B32K / 42.9 GB161
Note: green Score (e.g. "73.2") means that the model is better than SanjiWatsuki/longcat-10.7B.