GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 Stargate SG1 Uncensored Abliterated 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoning
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
ZE
zen 4b i1
Zen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
LL
Llama 3.1 8B UltraMedical
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
VI
vicuna-7b-v1.5-safeunlearning
Vicuna · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OC
OceanGPT-7b-v0.1
Oceangpt · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LE
LeoLM hessianai 13b
Leolm · mradermacher
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
MO
Moe 4x7b reason code qa i1
Moe · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
CodingReasoning
LF
LFM2.5 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
QW
Qwen2-Cantonese-7B-Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
WebWorld 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
LL
Deep Reasoning Llama 3.2 Dolphin3.0 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8B
Context256K
Q4_K_M4.9 GB
GGUF
CA
CAT Thinking 8B
Cat · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
CodingReasoningRoleplay
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
GGUF
CO
Yi Coder 9B
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
NO
NovaSpark i1
Novaspark · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
QW
Qwen 2.5 3b RP i1
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
Roleplay
ME
Meditron3 8B
Meditron · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
JA
Jais adapted 7B Reflection Tuning Natural Farmer
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
QW
Qwable 9B Claude Fable 5 Heretic
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Keep browsing