GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
WI
winter garden 7b delta
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
SZ
SzilviaB Daredevil LongWriter 8B abliterated i1
Szilviab · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 32B VL Instruct Polaris HI16 Heretic Uncensored
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
RoleplayVision
MI
Mahou-1.2-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
RA RFT Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
ColdBrew Qwen3.5 CharThink Base
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
Hermes 2 Pro Llama 3.1 70B i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
QW
RuntimeLabs Kayak Qwen3 VL 4B
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
MP
mpt 7b i1
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
CO
ContextualKunoichi KTO 7B i1
Contextualkunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2 0.5B NuminaMath TIR v1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
ZE
zephyr 7b hh dpo i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningVision
QW
Qwen2.5 Wolverine CODER 11B V2 128k Ctx
Qwen · mradermacher
Params10.9B
Context128K
Q4_K_M6.6 GB
Coding
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool use
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
TE
TeaAI Nemo 12B
Teaai · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
SI
SIRI 7B High
Siri · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3 0.9B A0.6B
Qwen · mradermacher
Params860M
Context40K
Q4_K_M0.6 GB
CodingReasoning
ER
Eros Scribe 10.7b v3 i1
Eros · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
RU
rudra i1
Rudra · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Tool use
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningRoleplayTool use
GE
Vikhr-Gemma-2B-instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v2
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
RP
RPBizkit v11 12B Thinking
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning

Keep browsing