GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
LittleInstructionJudge 4B v0.1
Littleinstructionjudge · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningRoleplayTool use
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
ER
Erk 32B
Erk · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
DI
DialoGPT MedDialog large
Dialogpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · mradermacher
Params129B
Context256K
Q4_K_M87.0 GB
GGUF
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
ReasoningRoleplay
EV
L3-8B-Everything-COT
Everything · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
MiniMA-2-1B
Minima · mradermacher
Params1.37B
Context4K
Q4_K_M0.8 GB
GGUF
LL
Waktaverse Llama 3 KO 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
PS
PsyMedLewdReMM Inverted 20B
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
llama-3-tulu-2-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
ST
L3-8B-Stheno-v3.2-abliterated
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingReasoning
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen3.5 9B Uncensored Cyber v3
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use

Keep browsing