GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy i1
Llama · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Qwen3 4B Thinking Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
KN
KnowLine 35B A3B Gen1
Knowline · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3 53B A3B TOTAL RECALL v1.4
Qwen · mradermacher
Params53B
Context40K
Q4_K_M32.1 GB
CodingReasoningTool use
YI
Yi 6B i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
ZI
Zion_Alpha_Instruction_Tuned
Zion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenELM 1_1B Instruct
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
OU
Oumuamua-7b-instruct-v2
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
YI
Yi 9B i1
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
NE
Neuron 46x4B Instruct
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Tool use
FL
Flint 40B A2.5B Abliterated
Flint · mradermacher
Params39.8B
Context256K
Q4_K_M24.2 GB
ReasoningTool use
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
CY
Cydonia 24B v4.3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
DE
DeepSeek V4 Pro Qwen3.5 4B
DeepSeek · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningVision
NE
NemoMix Unleashed 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
HE
Hemlock Philter 14B
Hemlock · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
BU
Buddy E4B v2
Buddy · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
OE
Oellm 9b 128k Theta32M
Oellm · mradermacher
Params9.1B
Context128K
Q4_K_M5.7 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
WI
WizardLM-2-7B-abliterated
Wizardlm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama 65b hf i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
GGUF
QW
WebWorld 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF

Keep browsing