GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MA
MagnumChronos i1
Magnumchronos · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HY
HyperLLama3.1 8b Nova i1
Hyperllama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool useVision
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
B4
B4 27B i1
mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Code-Llama-3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Coding
FA
Fara TARS 7B
Fara · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
ON
OneJev1.6 9B
Onejev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
UniReason Qwen3 14B No Think SFT
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningVision
OU
Oumuamua-7b-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
PO
Poro 34B chat i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
GGUF
RO
Rocinante 12B v1.1 i1
Rocinante · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MO
MotherEarth Hermes 8B i1
Motherearth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
CO
CodeMaster v1 7b
Codemaster · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingTool use
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 E4B It Abliterix
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision

Keep browsing