Additional Notes |
| |
Supported Languages |
|
LLM Name | C4AI Command R V01 GGUF |
Repository ๐ค | https://huggingface.co/second-state/C4AI-Command-R-v01-GGUF |
Model Name | C4AI Command-R |
Model Creator | Cohere |
Base Model(s) | |
Required VRAM | 13.8 GB |
Updated | 2025-09-23 |
Maintainer | second-state |
Model Type | cohere |
Model Files | |
Supported Languages | en fr de es it pt ja ko zh ar |
GGUF Quantization | Yes |
Quantization Type | gguf|q2|q4_k|q5_k |
Model Architecture | CohereForCausalLM |
License | cc-by-nc-4.0 |
Context Length | 8192 |
Model Max Length | 8192 |
Transformers Version | 4.38.2 |
Vocabulary Size | 256000 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
...ai Command R Plus EXL2 2.75bpw | 8K / 44.6 GB | 5 | 3 |
...4ai Command R Plus EXL2 8.0bpw | 8K / 109.8 GB | 7 | 2 |
...4ai Command R Plus EXL2 5.5bpw | 8K / 80.2 GB | 6 | 1 |
...ai Command R Plus EXL2 2.25bpw | 8K / 38 GB | 5 | 1 |
...4ai Command R Plus EXL2 6.5bpw | 8K / 93.1 GB | 5 | 0 |
...ommand R V01 EXL2 3.5bpw Rpcal | 8K / 21.2 GB | 5 | 2 |
C4ai Command R V01 EXL2 6.0bpw | 8K / 32.1 GB | 6 | 3 |
C4ai Command R V01 EXL2 5.0bpw | 8K / 27.8 GB | 6 | 1 |
...4ai Command R Plus 8.0bpw EXL2 | 8K / 110 GB | 6 | 1 |
C4ai Command R V01 EXL2 3.5bpw | 8K / 21.1 GB | 4 | 1 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐