GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy i1
Llama · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3 4B Thinking Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
KN
KnowLine 35B A3B Gen1
Knowline · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3 53B A3B TOTAL RECALL v1.4
Qwen · mradermacher
Params53B
Context40K
Q4_K_M32.1 GB
YI
Yi 6B i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
ZI
Zion_Alpha_Instruction_Tuned
Zion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenELM 1_1B Instruct
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
OU
Oumuamua-7b-instruct-v2
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
YI
Yi 9B i1
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
NE
Neuron 46x4B Instruct
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
FL
Flint 40B A2.5B Abliterated
Flint · mradermacher
Params39.8B
Context256K
Q4_K_M24.2 GB
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
CY
Cydonia 24B v4.3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
DeepSeek V4 Pro Qwen3.5 4B
DeepSeek · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
NE
NemoMix Unleashed 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
HE
Hemlock Philter 14B
Hemlock · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
HU
Hunyuan MT Chimera 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
BU
Buddy E4B v2
Buddy · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
OE
Oellm 9b 128k Theta32M
Oellm · mradermacher
Params9.1B
Context128K
Q4_K_M5.7 GB
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 65b hf i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
IR
Irbis-7b-v0.1
Irbis · mradermacher
Params7.47B
Context32K
Q4_K_M4.5 GB
QW
WebWorld 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB