GGUF models by dranger003

46 GGUF models quantized by dranger003 on Hugging Face. Sizes run from 2.77B to 132B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
DB
dbrx instruct iMat
Dbrx · dranger003
Params132B
Context32K
Smallest26.9 GB
GGUF
CO
c4ai-command-r-v01
Command R · dranger003
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
PH
microsoft/Phi-4-reasoning-vision-15B
Phi · dranger003
Params14.7B
Context32K
Smallest9.7 GB
ReasoningVision
DE
deepseek coder 33b instruct iMat
DeepSeek · dranger003
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
WH
WhiteRabbitNeo 33B v1.5 iMat
Whiterabbitneo · dranger003
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
BA
bagel 34b v0.4 iMat
Bagel · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
AI
airoboros 34b 3.2 iMat
Airoboros · dranger003
Params34.4B
Context195K
Smallest10.3 GB
GGUF
GE
gemma-7b-it
Gemma · dranger003
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
DE
CodeFuse DeepSeek 33B iMat
DeepSeek · dranger003
Params33.3B
Context16K
Smallest12.9 GB
GGUF
QW
openbuddy qwen1.5 14b v20.1 32k iMat
Qwen · dranger003
Params14.2B
Context32K
Smallest5.0 GB
GGUF
MI
e5 mistral 7b instruct
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
LL
bagel dpo 20b v04 llama iMat
Llama · dranger003
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
MI
Smaug Mixtral v0.1 iMat
Mistral · dranger003
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
CO
C4AI Command R7B
Command R · dranger003
Params8.03B
Context8K
Smallest5.1 GB
Tool use
MA
MambaHermes-3B
Mambahermes · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
Tool use
ST
dolphincoder-starcoder2-15b
StarCoder · dranger003
Params16B
Context16K
Smallest6.7 GB
Coding
BA
bagel dpo 34b v0.5 iMat
Bagel · dranger003
Params34.4B
Context195K
Smallest10.3 GB
GGUF
AL
AlphaMonarch laser iMat
Alphamonarch · dranger003
Params7.24B
Context32K
Smallest3.2 GB
GGUF
MA
mamba-2.8b-hf
Mamba · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
GGUF
GR
GritLM 8x7B iMat
Gritlm · dranger003
Params46.7B
Context32K
Smallest18.2 GB
GGUF
LW
LWM Text Chat 128K iMat
Lwm · dranger003
Params6.74B
Context128K
Q4_K_M4.1 GB
GGUF
ST
starcoder2-15b
StarCoder · dranger003
Params16B
Context16K
Smallest9.9 GB
Coding
MI
SFR Embedding Mistral
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
SM
Smaug 72B v0.1 iMat
Smaug · dranger003
Params72.3B
Context32K
Smallest16.2 GB
GGUF
BA
bagel-2.8b-v0.2
Bagel · dranger003
Params2.77B
Context1024K
Smallest2.0 GB
GGUF
ST
starcoder2-15b-instruct
StarCoder · dranger003
Params16B
Context16K
Smallest6.7 GB
Coding
BA
bagel 34b v0.2 iMat
Bagel · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GR
GritLM 7B
Gritlm · dranger003
Params7.24B
Context32K
Smallest4.4 GB
GGUF
CA
CausalLM 34b beta iMat
Causallm · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF

About dranger003 on Hugging Face

dranger003 has published 46 GGUF models that ggufmodels.com tracks, across families such as Mistral, Bagel and StarCoder. The most downloaded are c4ai-command-r-plus, dbrx instruct iMat and c4ai-command-r-v01.

The quants dranger003 publishes most often are Q8_0 (31), IQ3_XXS (28), IQ2_XS (22) and IQ2_XXS (20). Their Q4_K_M files range from 4.1 to 62.8 GB. Parameter counts run from 2.77B to 132B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has dranger003 published?

46 models are listed here, mainly from the Mistral, Bagel and StarCoder families. The most downloaded is c4ai-command-r-plus.

Which quants does dranger003 publish?

The most common are Q8_0 (31 models), IQ3_XXS (28 models), IQ2_XS (22 models) and IQ2_XXS (20 models).

Keep browsing