What are the hardware requirements for DeepCNCFQuantized?

DeepCNCFQuantized requires approximately 5.3 GB of VRAM and supports a context window of 8K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed DeepCNCFQuantized and how large is it?

DeepCNCFQuantized is developed by Kubermatic, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate DeepCNCFQuantized?

DeepCNCFQuantized is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

DeepCNCFQuantized by Kubermatic — VRAM 5.3GB, 8K context

Name: DeepCNCFQuantized
Author: Kubermatic

DeepCNCFQuantized is an open-source language model by Kubermatic. Features: 7b LLM, VRAM: 5.3GB, Context: 8K, License: mit, Quantized, LLM Explorer Score: 0.14.

Endpoints compatible Gemma Ggml Gguf Q4 Quantized Region:us

Model Card on HF 🤗: https://huggingface.co/Kubermatic/DeepCNCFQuantized

DeepCNCFQuantized Benchmarks

LLME Score: 0.13722

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

DeepCNCFQuantized (Kubermatic/DeepCNCFQuantized)

🌟 Advertise your project 🚀

DeepCNCFQuantized Parameters and Internals

LLM Name	DeepCNCFQuantized
Repository 🤗	https://huggingface.co/Kubermatic/DeepCNCFQuantized
Model Size	7b
Required VRAM	5.3 GB
Updated	2026-04-09
Maintainer	Kubermatic
Model Type	gemma
Model Files	5.3 GB
GGML Quantization	Yes
GGUF Quantization	Yes
Quantization Type	gguf\|ggml\|q4\|q4_k
Model Architecture	GemmaForCausalLM
License	mit
Context Length	8192
Model Max Length	8192
Transformers Version	4.41.1
Tokenizer Class	GemmaTokenizer
Padding Token	<pad>
Vocabulary Size	256000
Torch Data Type	float32

Best Alternatives to DeepCNCFQuantized

Best Alternatives	Context / RAM	Downloads	Likes
Gemma 7B Uawiki 1B	8K / 17.1 GB	24	0
CNCF	8K / 5.3 GB	12	0
VolareQuantized	8K / 5.3 GB	226	1
VolareQuantized	8K / 5.3 GB	36	1
Gemma 7B It	8K / 17.1 GB	38213	1243
Gemma 7B	8K / 17.1 GB	29936	3296
Gemma 1.1 7B It GGUF	8K / 5.3 GB	128	1
Train06	8K / 9.1 GB	21	0
Llama2 Kazakh 7B GGUF	8K / 4.1 GB	10	0
Gemma 7B	8K / 17.1 GB	36	0

Note: green Score (e.g. "73.2") means that the model is better than Kubermatic/DeepCNCFQuantized.

Rank the DeepCNCFQuantized Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53254 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

DeepCNCFQuantized by Kubermatic

» All LLMs » Kubermatic » DeepCNCFQuantized URL Share it on

DeepCNCFQuantized Benchmarks

DeepCNCFQuantized Parameters and Internals

Best Alternatives to DeepCNCFQuantized

Rank the DeepCNCFQuantized Capabilities

What open-source LLMs or SLMs are you in search of? 53254 in total.