GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
SH
shadow clown 7B slerp
Shadow · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
FL
Flow Judge v0.1
Flow · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
LLDS A GRPO Qwen2.5 7B Ins i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AN
ANTRU 3B
Antru · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
LL
Llama 3.1 8B Instruct RoleVerse SFT DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
MI
Mixtral AI AlphaTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow-7b-instruct-v0.1
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3Guard Gen 0.6B
Qwen · mradermacher
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
IC
iCoder 27B
Icoder · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
Coding
QW
Qwen3 Sex
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MP
Mpt 7b 8k Chat
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
Coding
CH
AA Chameleon 7b Base
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
MI
KawaiiMahou-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma Kimu 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
SP
RP Spectrum 24B
Spectrum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL PKDick V
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen3.5 9B DS9 USS Defiant
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
LL
Llama3.1 8B PlumMath
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Discoleo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32 128k Ctx
Qwen · mradermacher
Params5.94B
Context128K
Q4_K_M3.6 GB
CodingReasoning
CO
Codegeex4 All 9b
Codegeex · mradermacher
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
MA
Mammoth 1
Mammoth · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
PY
pythia-1.4b-dpo-full
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF

Keep browsing