GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
HO
K2 Horizon 3.7B Claude Opus Reasoning Distilled
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
PY
Pythia 12b
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GO
Goetia 24B v1.4 Heretic
Goetia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
TO
ToolSpace 35B A3B
Toolspace · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
ColdBrew Qwen3.5 RP_Base CharThink
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
Deepseek R1 Distill NSFW RPv1
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
ThinCtx Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
D3
d3 i1
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
FR
Free_Sydney_13b_HF
Free · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama3.1 Heretic Unsensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CY
Cydonia 24B v4.3 Heretic
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
FR
FrogNano 4B 2609 Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
NO
Noema 1.5 4B Deep
Noema · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 4B Anon Reasoning v2
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
PY
Pythia 160m Deduped
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
SU
SummLlama3.1 8B
Summllama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
FI
Fin R1
Fin · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
AP
Apertus 70B Instruct 2509 Abliterated
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
PH
Phi 4 Reasoning plus_Nemotron Reasoning 0803_SFT GRPO
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
SummOrchestra Qwen3 8B GRPO BRLP SAMSUM
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB