GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
MA
MagnumChronos i1
Magnumchronos · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HY
HyperLLama3.1 8b Nova i1
Hyperllama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
B4
B4 27B i1
mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Code-Llama-3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
FA
Fara TARS 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ON
OneJev1.6 9B
Onejev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
UniReason Qwen3 14B No Think SFT
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OU
Oumuamua-7b-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
PO
Poro 34B chat i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
RO
Rocinante 12B v1.1 i1
Rocinante · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
MotherEarth Hermes 8B i1
Motherearth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
CodeMaster v1 7b
Codemaster · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 E4B It Abliterix
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB