Cogito V2 Preview Deepseek 671B MoE FP8 by deepcogito

 »  All LLMs  »  deepcogito  »  Cogito V2 Preview Deepseek 671B MoE FP8   URL Share it on

Cogito V2 Preview Deepseek 671B MoE FP8 is an open-source language model by deepcogito. Features: 671.2b LLM, VRAM: 215GB, Context: 160K, License: mit, MoE, LLM Explorer Score: 0.19.

Base model:deepseek-ai/deepsee... Base model:quantized:deepseek-...   Compressed-tensors   Conversational   Custom code   Deepseek v3   Endpoints compatible   Moe   Region:us   Safetensors   Sharded   Tensorflow

Cogito V2 Preview Deepseek 671B MoE FP8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Cogito V2 Preview Deepseek 671B MoE FP8 (deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8)

Cogito V2 Preview Deepseek 671B MoE FP8 Parameters and Internals

LLM NameCogito V2 Preview Deepseek 671B MoE FP8
Repository 🤗https://huggingface.co/deepcogito/cogito-v2-preview-deepseek-671B-MoE-FP8 
Base Model(s)  DeepSeek V3 Base   deepseek-ai/DeepSeek-V3-Base
Model Size671.2b
Required VRAM215 GB
Updated2026-07-22
Maintainerdeepcogito
Model Typedeepseek_v3
Model Files  5.0 GB: 1-of-135   5.0 GB: 2-of-135   5.0 GB: 3-of-135   5.0 GB: 4-of-135   5.0 GB: 5-of-135   5.0 GB: 6-of-135   5.0 GB: 7-of-135   5.0 GB: 8-of-135   5.0 GB: 9-of-135   5.0 GB: 10-of-135   5.0 GB: 11-of-135   5.0 GB: 12-of-135   5.0 GB: 13-of-135   5.0 GB: 14-of-135   5.0 GB: 15-of-135   5.0 GB: 16-of-135   5.0 GB: 17-of-135   5.0 GB: 18-of-135   5.0 GB: 19-of-135   5.0 GB: 20-of-135   5.0 GB: 21-of-135   5.0 GB: 22-of-135   5.0 GB: 23-of-135   5.0 GB: 24-of-135   5.0 GB: 25-of-135   5.0 GB: 26-of-135   5.0 GB: 27-of-135   5.0 GB: 28-of-135   5.0 GB: 29-of-135   5.0 GB: 30-of-135   5.0 GB: 31-of-135   5.0 GB: 32-of-135   5.0 GB: 33-of-135   5.0 GB: 34-of-135   5.0 GB: 35-of-135   5.0 GB: 36-of-135   5.0 GB: 37-of-135   5.0 GB: 38-of-135   5.0 GB: 39-of-135   5.0 GB: 40-of-135   5.0 GB: 41-of-135   5.0 GB: 42-of-135   5.0 GB: 43-of-135
Model ArchitectureDeepseekV3ForCausalLM
Licensemit
Context Length163840
Model Max Length163840
Transformers Version4.53.0
Vocabulary Size128815
Torch Data Typebfloat16

Rank the Cogito V2 Preview Deepseek 671B MoE FP8 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 55396 in total.

Our Social Media →  
Original data from HuggingFace, Arena and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a