GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
0X
0x01 8x7b hf i1
mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AP
Apocrypha-7b
Apocrypha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
GEV 26B Decide
Gev · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
CH
Chaotic Harmony 24B
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
shisa v2.1 llama3.2 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
TE
TerminalHorizon 27B
Terminalhorizon · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NE
Huihui NVIDIA Nemotron Nano 9B v2 Abliterated
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
NO
Nontoxic PiVoT Bagel RP 34b i1
Nontoxic · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
ON
OneJev 27B
Onejev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
X Coder RL Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
MI
Mixtral AI CyberRolePlay Orca
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB