GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
QW
Qwen3.5 40B RoughHouse Claude 4.6 Opus Polar Deckard Uncensored Heretic Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LI
Lil Beastie 4b
Lil · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
NE
Neuron 4B Instruct
Neuron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
NE
Neuraljack 12B MoE
Neuraljack · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
KI
RP King 12b
King · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
BO
Borealis 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
GGUF
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
GR
Granite 4.1 8b Abliterated AND Disinhibited
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
GGUF
QW
QiMing Holos Plus Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
ME
MegaDolphin 120b i1
Megadolphin · mradermacher
Params120B
Context4K
Smallest25.6 GB
GGUF
LL
Mini Lama 8B Base
Llama · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
SP
Spark X2.6 4B Base
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
LL
llama 65b instruct
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
SE
SearchQwen2.5 7B
Searchqwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PL
Pluto i1
Pluto · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
MI
General Stories Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
L3 DARKEST PLANET 16.5B i1
Darkest · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
Roleplay
EG
Ege 8b 1.1
Ege · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Roleplay
KE
Keural Cortex 8B v1.0 1
Keural · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
Tool use
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingReasoningTool use
ME
MedGo
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
ED
EdgeRunner Command Nested
Edgerunner · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing