GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 27B Omnimerge v6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FL
Flux Prompt Enhance
Flux · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DI
dictalm2.0-instruct
Dictalm · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
UG
L3-8B-UGI-DontPlanToEnd-test
Ugi · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL PaperWitch Heresy
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 8x7B Vee Eight Coder Instruct 53B
Qwen · mradermacher
Params53.2B
Context32K
Q4_K_M32.4 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
TI
TinySlime-1.1B-Chat-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MO
MotherEarth_1.0
Motherearth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Fireball Llama 3.1 8B Philos Reflection v0.3 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
KO
Koa AI v2 Code 9B
Koa · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.6 27B A3B Coder
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
QW
Qwen3 VL 12B Thinking Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
CA
Calme-7B-Instruct-v0.1.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Godzilla Coder V2 51B
Qwen · mradermacher
Params51B
Context32K
Q4_K_M30.7 GB
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Menage 12B
Menage · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LO
LogicLumina-L3-13B-v2
Logiclumina · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Citrus1.0 Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
KH
kheops compressed
Kheops · mradermacher
Params283M
Context2K
Q4_K_M0.2 GB
EU
Eurus 70b sft fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DI
DISC LawLLM
Disc · mradermacher
Params13.3B
Context4K
Q4_K_M8.6 GB
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB