GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
AM
AmberChat
Amberchat · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
EK
Ekbasis Skopos 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
AI
aiXcompact 4B
Aixcompact · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
ME
Medgemma 27b Text It Abliterated
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
AS
AstaBrief_8B
Astabrief · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
Qwen3.5 9b Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool useVision
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool useVision
SH
Shaylah Darija 4b Merged
Shaylah · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
ZO
Zoro i1
Zoro · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool use
HE
Hermes 2 DPO WestLake 7B v2
Hermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Tool use
QW
Twi Qwen v1 Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
ME
MechVL 4B RL
Mechvl · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningVision
SO
SOR ColdBrew 12B Think RP Base
Sor · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GP
Gpt Oss 20b Unsloth Puzzle V2
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
TR
TranslatePsy AfriSLM 4B
Translatepsy · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
AN
Andromeda 8B Coder i1
Andromeda · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CodingTool use
EV
EAN 7B i1
Evan · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
SU
SummLlama3 8B i1
Summllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing