GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GR
Grok Oss Thanatos
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
IN
Index Translate 35B A3B Preview
Index · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.5 9B Claude 4.6 Opus Deckard V4.2 Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8 4B Distill Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
EX
Experiment26 7B
Experiment · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
ZE
zephyr 7b hh dpo
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
YI
Yi-1.5-9B-32K
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Dolphin Mistral 24B Venice Edition Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
JA
Jais Adapted 7b Chat
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
MI
Huihui MiniCPM V 4.6 Abliterated
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 7B Instruct 1M Heretic
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ST
StarCoder
StarCoder · mradermacher
Params15.5B
Context8K
Q4_K_M10.0 GB
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
QW
Qwen3 VL 32B Gemini Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
CO
C4AI inverse sft model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
TE
TerraSense
Terrasense · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Fireball Alpaca Llama3.1 8B Philos i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SO
solar merge v1.0 i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB