GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
SignOfFour
Qwen · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
VU
VulnLLM R 7B
Vulnllm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 9B OmniCoder Claude Polaris
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SO
SOLAR 10.7B v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Air Striker Mixtral 8x7B ZLoss Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
IN
InverseCoder-DS-6.7B
Inversecoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
PS
PsyMedDestroyer i1
Psymeddestroyer · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GL
Huihui GLM 4.7 Flash Abliterated 57B
GLM · mradermacher
Params55.6B
Context198K
Q4_K_M33.7 GB
GP
GPT OSS Cybersecurity 20B Merged
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
AN
Anime Girl 1.5B
Anime · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Gemma 4 E2B It Uncensored MAX
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
MA
Marco Mini Instruct
Marco · mradermacher
Params17.3B
Context32K
Q4_K_M10.5 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Clinical BR Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
SH
shisa v2.1 unphi4 14b
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
WI
WizardCoder 15B V1.0
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NA
Nanbeige4.3 33B
Nanbeige · mradermacher
Params33.1B
Context512K
Q4_K_M20.1 GB
QW
Qwen3.5 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB