GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
LI
LittleInstructionJudge 4B v0.1
Littleinstructionjudge · mradermacher
Params3.96B
Context8K
Q4_K_M2.4 GB
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CH
Chocolatine 14B Instruct DPO v1.2
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ER
Erk 32B
Erk · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
DI
DialoGPT MedDialog large
Dialogpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · mradermacher
Params129B
Context256K
Q4_K_M87.0 GB
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
EV
L3-8B-Everything-COT
Everything · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniMA-2-1B
Minima · mradermacher
Params1.37B
Context4K
Q4_K_M0.8 GB
LL
Waktaverse Llama 3 KO 8B Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
PS
PsyMedLewdReMM Inverted 20B
Psymedlewdremm · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
LL
llama-3-tulu-2-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
ST
L3-8B-Stheno-v3.2-abliterated
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.5 9B Uncensored Cyber v3
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB