LLM EXPLORER 58,873 MODELS INDEXED

Cogito V2 Preview Deepseek 671B MoE FP8 by deepcogito

By deepcogito · 50 downloads
HF Repo ↗ Copy URL

Cogito V2 Preview Deepseek 671B MoE FP8 is an open-source language model by deepcogito. Features: 671.2b LLM, VRAM: 215GB, Context: 160K, License: mit, MoE, LLM Explorer Score: 0.19.

Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-...   Compressed-tensors   Conversational   Custom code   Deepseek v3   Endpoints compatible   Moe   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8 

Cogito V2 Preview Deepseek 671B MoE FP8 Parameters and Internals

LLM NameCogito V2 Preview Deepseek 671B MoE FP8
Repository 🤗https://huggingface.co/deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8 
Base Model(s)  DeepSeek V3 Base   deepseek-ai/DeepSeek-V3-Base
Model Size671.2b
Required VRAM215 GB
Updated2026-08-02
Maintainerdeepcogito
Model Typedeepseek_v3
Model Files  5.0 GB: 1-of-135   5.0 GB: 2-of-135   5.0 GB: 3-of-135   5.0 GB: 4-of-135   5.0 GB: 5-of-135   5.0 GB: 6-of-135   5.0 GB: 7-of-135   5.0 GB: 8-of-135   5.0 GB: 9-of-135   5.0 GB: 10-of-135   5.0 GB: 11-of-135   5.0 GB: 12-of-135   5.0 GB: 13-of-135   5.0 GB: 14-of-135   5.0 GB: 15-of-135   5.0 GB: 16-of-135   5.0 GB: 17-of-135   5.0 GB: 18-of-135   5.0 GB: 19-of-135   5.0 GB: 20-of-135   5.0 GB: 21-of-135   5.0 GB: 22-of-135   5.0 GB: 23-of-135   5.0 GB: 24-of-135   5.0 GB: 25-of-135   5.0 GB: 26-of-135   5.0 GB: 27-of-135   5.0 GB: 28-of-135   5.0 GB: 29-of-135   5.0 GB: 30-of-135   5.0 GB: 31-of-135   5.0 GB: 32-of-135   5.0 GB: 33-of-135   5.0 GB: 34-of-135   5.0 GB: 35-of-135   5.0 GB: 36-of-135   5.0 GB: 37-of-135   5.0 GB: 38-of-135   5.0 GB: 39-of-135   5.0 GB: 40-of-135   5.0 GB: 41-of-135   5.0 GB: 42-of-135   5.0 GB: 43-of-135
Model ArchitectureDeepseekV3ForCausalLM
Licensemit
Context Length163840
Model Max Length163840
Transformers Version4.53.0
Vocabulary Size128815
Torch Data Typebfloat16