LLM EXPLORER 59,420 MODELS INDEXED

Internlm3 8B Instruct Smoothquant Int8 by internlm

By internlm · 26 downloads
HF Repo ↗ Copy URL

Internlm3 8B Instruct Smoothquant Int8 is an open-source language model by internlm. Features: 8b LLM, VRAM: 9.9GB, Context: 32K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.16.

  Arxiv:2403.17297   Conversational   Custom code   En   Instruct   Internlm3   Pytorch   Region:us   Sharded   Smooth quant   Zh
Model Card on HF 🤗: https://huggingface.co/internlm/internlm3-8b-instruct-smoothquant-int8 

Internlm3 8B Instruct Smoothquant Int8 Parameters and Internals

LLM NameInternlm3 8B Instruct Smoothquant Int8
Repository 🤗https://huggingface.co/internlm/internlm3-8b-instruct-smoothquant-int8 
Model Size8b
Required VRAM9.9 GB
Updated2026-08-07
Maintainerinternlm
Model Typeinternlm3
Instruction-BasedYes
Model Files  2.0 GB: 1-of-5   2.0 GB: 2-of-5   2.0 GB: 3-of-5   2.0 GB: 4-of-5   1.9 GB: 5-of-5
Supported Languagesen zh
Model ArchitectureInternLM3ForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.47.0
Is Biased0
Tokenizer ClassInternLM3Tokenizer
Padding Token</s>
Vocabulary Size128512
Torch Data Typefloat16

Best Alternatives to Internlm3 8B Instruct Smoothquant Int8

Best Alternatives
Context / RAM
Downloads
Likes
Internlm3 8B Instruct32K / 17.6 GB88831232
...m3 8B Instruct Smoothquant Fp832K / 9.9 GB221
...ernlm3 8B Instruct Abliterated32K / 17.6 GB166
Internlm3 8B Instruct AWQ32K / 6.2 GB936
...nternlm3 8B Instruct Gptq Int432K / 6.1 GB84
Note: green Score (e.g. "73.2") means that the model is better than internlm/internlm3-8b-instruct-smoothquant-int8.