LLM EXPLORER 59,358 MODELS INDEXED

Shears Mpt 7B 50 Base by IntelLabs

By IntelLabs · 5 downloads

Shears Mpt 7B 50 Base is an open-source language model by IntelLabs. Features: 7b LLM, VRAM: 13.3GB, License: apache-2.0, LLM Explorer Score: 0.12.

  Arxiv:2306.11695   Arxiv:2404.10934   Arxiv:2501.16372   Custom code   En   Endpoints compatible   Mpt   Region:us   Safetensors   Sharded   Tensorflow

Shears Mpt 7B 50 Base Parameters and Internals

Additional Notes 
The model is a sparsified version of the MPT-7B with 50% sparsity used as a base model in Shears.
LLM NameShears Mpt 7B 50 Base
Repository πŸ€—https://huggingface.co/IntelLabs/shears-mpt-7b-50-base 
Model Size7b
Required VRAM13.3 GB
Updated2026-07-31
MaintainerIntelLabs
Model Typempt
Model Files  9.9 GB: 1-of-2   3.4 GB: 2-of-2
Supported Languagesen
Model ArchitectureMPTForCausalLM
Licenseapache-2.0
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50432
Torch Data Typefloat16

Best Alternatives to Shears Mpt 7B 50 Base

Best Alternatives
Context / RAM
Downloads
Likes
Mpt 7B Chat0K / 13.3 GB80920518
Mpt 7B Assistant0K / 13.3 GB111
Mpt 7B0K / 13.3 GB184601173
Mpt 7B Instruct0K / 13.3 GB7946470
Mpt 7B Storywriter0K / 13.3 GB2261839
Mpt 7B Int8 Ov0K / 0 GB130
Mpt 7B0K / 26.5 GB30641
Mpt 7B 8K0K / 13.3 GB191526
Mpt 7B 8K Chat0K / 13.3 GB194240
Mpt 7B 8K Instruct0K / 13.3 GB201227
Note: green Score (e.g. "73.2") means that the model is better than IntelLabs/shears-mpt-7b-50-base.