GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian Qin V2 V3 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
WebWorld 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 4x7B Quad Coder Instruct 30B 128k Ctx
Qwen · mradermacher
Params30.4B
Context128K
Q4_K_M18.5 GB
BL
BlenderLLM
Blenderllm · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
AG
Agent 7b v1 128k
Agent · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CH
ChatGPT-2.V2
Chatgpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
QW
Qwen3.6 27B A3B CoderX
Qwen · mradermacher
Params26.2B
Context256K
Q4_K_M16.1 GB
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
YI
dolphin-2.9.1-yi-1.5-9b
Yi · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
minecraft
Minecraft · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB