Command R GGUF models

173 GGUF models in the Command R family, quantized by 70 uploaders. Sizes run from 29M to 160B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
CO
commandr
Command R · DavidAU
Params35B
Context128K
Smallest11.1 GB
Roleplay
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
commandr
Command R · DavidAU
Params35B
Context128K
Q4_K_M21.5 GB
Roleplay
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
GGUF
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
C4AI orpo model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
CO
C4AI inverse sft model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
Command R 35b Writer v2
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
GGUF
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
c4ai-command-r-plus
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GGUF
CO
C4Ai Command R7B 12 2024 Heretic
Command R · mradermacher
Params8B
Context129K
Q4_K_M5.1 GB
Roleplay
CO
C4Ai Command R7B 12 2024
Command R · oncu
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
CO
C4Ai Command R7B Arabic 02 2025
Command R · matrixportalx
Params8.03B
Context16K
Q4_K_M5.1 GB
Tool use
CO
c4ai command r7b 12 2024 heretic
Command R · saidutta69
Params8.03B
Context129K
Q4_K_M5.1 GB
RoleplayTool use
CO
C4AI Dpo Model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
CO
Models CohereForAI C4Ai Command A 03 2025
Command R · MaziyarPanahi
Params111B
Context16K
Q4_K_M67.1 GB
Tool use
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CO
c4ai command r v01
Command R · andrewcanis
Params35B
Context128K
Q4_K_M21.5 GB
GGUF

About the Command R GGUF models

Command R is represented on ggufmodels.com by 173 GGUF models, quantized by 70 uploaders on Hugging Face. The most downloaded are C4Ai Command R7B 12 2024, C4Ai Command R Plus 08 2024 and C4Ai Command R Plus 08 2024. Parameter counts run from 29M to 160B, and the longest trained context window is 256K tokens.

A Q4_K_M file of a Command R model is between 0.1 to 96.6 GB, which is the quant most people start with. Most files come from mradermacher (46), Lucy-in-the-Sky (11) and bartowski (8). The quants you will meet most often are Q4_K_M (114), Q2_K (99), Q6_K (96) and Q5_K_M (89), where the number is how many models offer that quant.

Frequently asked questions

Which Command R GGUF should I download?

The most downloaded Command R GGUF here is C4Ai Command R7B 12 2024. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Command R model need?

Q4_K_M files of Command R models on this site range from 0.1 to 96.6 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Command R GGUF files come from?

The most common quantizers here are mradermacher, Lucy-in-the-Sky and bartowski. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing