GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 Stargate SG1 Uncensored Abliterated 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ZE
zen 4b i1
Zen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
VI
vicuna-7b-v1.5-safeunlearning
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OC
OceanGPT-7b-v0.1
Oceangpt · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
LE
LeoLM hessianai 13b
Leolm · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
MO
Moe 4x7b reason code qa i1
Moe · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LF
LFM2.5 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
QW
Qwen2-Cantonese-7B-Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
WebWorld 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
LL
Deep Reasoning Llama 3.2 Dolphin3.0 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8B
Context256K
Q4_K_M4.9 GB
CA
CAT Thinking 8B
Cat · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
CO
Yi Coder 9B
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
NO
NovaSpark i1
Novaspark · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen 2.5 3b RP i1
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
ME
Meditron3 8B
Meditron · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
JA
Jais adapted 7B Reflection Tuning Natural Farmer
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwable 9B Claude Fable 5 Heretic
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB