LLM EXPLORER 57,918 MODELS INDEXED

DeepSeek V3.1 Terminus W4AFP8 by tencent

By tencent · 593 downloads

DeepSeek V3.1 Terminus W4AFP8 is an open-source language model by tencent. Features: 349.2b LLM, VRAM: 366.7GB, Context: 160K, License: mit, LLM Explorer Score: 0.22.

  8-bit Base model:deepseek-ai/deepsee... Base model:finetune:deepseek-a...   Conversational   Custom code   Deepseek v3   Endpoints compatible   Fp8   Int4   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Tensorrt-model-optimizer

DeepSeek V3.1 Terminus W4AFP8 Parameters and Internals

LLM NameDeepSeek V3.1 Terminus W4AFP8
Repository 🤗https://huggingface.co/tencent/DeepSeek-V3.1-Terminus-W4AFP8 
Base Model(s)  deepseek-ai/DeepSeek-V3.1-Terminus   deepseek-ai/DeepSeek-V3.1-Terminus
Model Size349.2b
Required VRAM366.7 GB
Updated2026-08-08
Maintainertencent
Model Typedeepseek_v3
Model Files  30.4 GB: 0-of-9   43.6 GB: 1-of-9   43.6 GB: 2-of-9   43.6 GB: 3-of-9   43.6 GB: 4-of-9   43.6 GB: 5-of-9   43.6 GB: 6-of-9   43.6 GB: 7-of-9   31.1 GB: 8-of-9
Model ArchitectureDeepseekV3ForCausalLM
Licensemit
Context Length163840
Model Max Length163840
Transformers Version4.44.2
Tokenizer ClassLlamaTokenizerFast
Beginning of Sentence Token<|begin▁of▁sentence|>
End of Sentence Token<|end▁of▁sentence|>
Vocabulary Size129280
Torch Data Typebfloat16