Command R Gptq by NEURALDEEPTECH

 ยป  All LLMs  ยป  NEURALDEEPTECH  ยป  Command R Gptq   URL Share it on

Command R Gptq is an open-source language model by NEURALDEEPTECH. Features: LLM, VRAM: 27.4GB, Context: 8K, License: cc-by-nc-4.0, Quantized, LLM Explorer Score: 0.13.

  4-bit   4bit   Cohere   Endpoints compatible   Gptq   Quantized   Region:us

Command R Gptq Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Command R Gptq (NEURALDEEPTECH/command-r-gptq)
๐ŸŒŸ Advertise your project ๐Ÿš€

Command R Gptq Parameters and Internals

LLM NameCommand R Gptq
Repository ๐Ÿค—https://huggingface.co/NEURALDEEPTECH/command-r-gptq 
Required VRAM27.4 GB
Updated2026-04-03
MaintainerNEURALDEEPTECH
Model Typecohere
Model Files  27.4 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureCohereForCausalLM
Licensecc-by-nc-4.0
Context Length8192
Model Max Length8192
Transformers Version4.39.1
Tokenizer ClassCohereTokenizer
Padding Token<PAD>
Vocabulary Size256000
Torch Data Typefloat16

Best Alternatives to Command R Gptq

Best Alternatives
Context / RAM
Downloads
Likes
...ai Command R Plus 08 2024 8bit128K / 110.1 GB532
C4ai Command R 08 2024 8bit128K / 34.2 GB212
C4ai Command R Plus 8bit8K / 113 GB713
...4ai Command R Plus EXL2 8.0bpw8K / 109.8 GB112
...ai Command R Plus EXL2 2.75bpw8K / 44.6 GB33
...ai Command R Plus EXL2 2.25bpw8K / 38 GB61
...4ai Command R Plus EXL2 5.5bpw8K / 80.2 GB11
...4ai Command R Plus EXL2 6.5bpw8K / 93.1 GB50
...ommand R V01 EXL2 3.5bpw Rpcal8K / 21.2 GB52
C4ai Command R V01 4bit8K / 22.7 GB17723
Note: green Score (e.g. "73.2") means that the model is better than NEURALDEEPTECH/command-r-gptq.

Rank the Command R Gptq Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52473 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a