GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
CH
chronos007 70b i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
WI
WizardMath 7B V1.0
Wizardmath · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
MY
MythoLogic-Mini-7b
Mythologic · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
BA
bagel 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
HA
Hamanasu 15B Adventure i1
Hamanasu · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
Qwen3 Reranker 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CO
Yi Coder 9B
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
MI
Devstral Small 2505 Abliterated
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MA
Magidonia 24B v4.3 Heretic v3
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
JA
JapanRailwaysimLLM
Japanrailwaysimllm · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
HU
Huihui4 8B A4B v2
Huihui · mradermacher
Params8.1B
Context256K
Q4_K_M5.4 GB
NO
Norobara ZLoss 8x7B
Norobara · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
TI
TinyEnsemble-3x1.1B-TinyMoE
Tinyensemble · mradermacher
Params2.62B
Context4K
Q4_K_M1.6 GB
LL
llama-3-Nephilim-v2-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
HA
Hathor v4.6 i1
Hathor · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
LL
Llama-3-Oasis-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB