GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
FI
Fimbulvetr 40 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LI
Lilith 31B v1.0
Lilith · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CH
Chaotic Order 24B V3
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
IR
Irene-RP-v2-7B
Irene · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
Amaretto 8B
Amaretto · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwen3 30B A3B ArliAI RpR v4 Fast
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
DI
DialFactSum ACU 8B
Dialfactsum · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
KA
Kadoe 4B
Kadoe · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.2 3B MoE 4Expert
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
MI
Ministral 3b instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
Qwen3 14B Base
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NA
NaruMOE-3x7B-v2
Narumoe · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
QW
MiRL Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
EL
Elephant 1
Elephant · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QU
Quyet 1.0 Large
Quyet · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
YI
Nous Hermes 2 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB