LLM EXPLORER 59,358 MODELS INDEXED

Internlm3 8B Instruct AWQ by internlm

By internlm · 93 downloads
HF Repo ↗ Copy URL

Internlm3 8B Instruct AWQ is an open-source language model by internlm. Features: 8b LLM, VRAM: 6.2GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.16.

  Arxiv:2403.17297   4-bit   Awq   Conversational   Custom code   En   Instruct   Internlm3   Pytorch   Quantized   Region:us   Sharded   Zh
Model Card on HF 🤗: https://huggingface.co/internlm/internlm3-8b-instruct-awq 

Internlm3 8B Instruct AWQ Parameters and Internals

LLM NameInternlm3 8B Instruct AWQ
Repository 🤗https://huggingface.co/internlm/internlm3-8b-instruct-awq 
Model Size8b
Required VRAM6.2 GB
Updated2026-07-26
Maintainerinternlm
Model Typeinternlm3
Instruction-BasedYes
Model Files  2.0 GB: 1-of-4   2.0 GB: 2-of-4   1.1 GB: 3-of-4   1.1 GB: 4-of-4
Supported Languagesen zh
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureInternLM3ForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.47.0
Is Biased0
Tokenizer ClassInternLM3Tokenizer
Padding Token</s>
Vocabulary Size128512
Torch Data Typefloat16

Best Alternatives to Internlm3 8B Instruct AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Internlm3 8B Instruct32K / 17.6 GB88831232
...m3 8B Instruct Smoothquant Fp832K / 9.9 GB221
...3 8B Instruct Smoothquant Int832K / 9.9 GB264
...nternlm3 8B Instruct Gptq Int432K / 6.1 GB84
...ernlm3 8B Instruct Abliterated32K / 17.6 GB166
Note: green Score (e.g. "73.2") means that the model is better than internlm/internlm3-8b-instruct-awq.