GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian Qin V2 V3 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
GGUF
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
QW
WebWorld 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 4x7B Quad Coder Instruct 30B 128k Ctx
Qwen · mradermacher
Params30.4B
Context128K
Q4_K_M18.5 GB
Coding
BL
BlenderLLM
Blenderllm · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
AG
Agent 7b v1 128k
Agent · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
Coding
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Roleplay
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
CH
ChatGPT-2.V2
Chatgpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Vision
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
QW
Qwen3.6 27B A3B CoderX
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
Coding
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
minecraft
Minecraft · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing