GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi-9B-Coder
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding
QW
Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
AT
Athene 70B
Athene · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
mistral 7b orpo v5.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3 song lyrics 1.0 i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
ME
mera mix 4x7B i1
Mera · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
GP
Gpt Oss 20b Uncensored Heretic
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
SW
Swallow-7b-plus-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
SA
Saltware-solar-10.7b-v1.0
Saltware · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
SM
SmolLM2 1.7B Instruct Uncensored
SmolLM · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Huihui Qwen3 1.7B Abliterated v2
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
LI
limstral 7B v0.1
Limstral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama-3-70b-Uncensored-Lumi-Tess-gradient
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
GGUF
IN
L3.1 Instruct Guru 8B
Instruct · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Ektome Qwen3 30B A3B PristinelyUncensored
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
AR
ARWKV 7B Preview 0.1
Arwkv · mradermacher
Params8.29B
Context1024K
Q4_K_M5.2 GB
GGUF
QW
Qwen3.5 24B A3B Claude Opus Gemini 3.1 Pro Reasoning Distilled Heretic
Qwen · mradermacher
Params24.5B
Context256K
Q4_K_M15.0 GB
Reasoning
QW
QwQ LCoT2 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
OM
OmniLing V1 8b experimental i1
Omniling · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PR
Prism Coder 9b
Prism · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingTool useVision
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoning
MI
Mistral Small 3.2 24B Instruct 2506 Ultra Uncensored Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct KhanAcademy v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision

Keep browsing