GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Crow 9B Opus 4.6 Distill Heretic_Qwen3.5
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CA
MN CaptainErisNebula 12B Chimera v1.1 Heretic Uncensored Abliterated
Captainerisnebula · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ON
OneJev1.6 4B
Onejev · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen2.5 1.5b Uncensored
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
OP
openchat-3.5-0106
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.5 9B Abliterated v2 MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
SE
Seed Coder 8B Instruct
Seed · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
MP
Mpt 30b
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
LE
LeeMerge 7B slerp
Leemerge · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
YI
EVA Yi 1.5 9B 32K V1 i1
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
NO
Noromaid 20b v0.1.1 i1
Noromaid · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
TU
tulu 2 70b i1
Tulu · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
MA
MN 12B Mag Mell R1 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hermes 4 14B
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
MA
Maincoder 1B
Maincoder · mradermacher
Params1.03B
Context2K
Q4_K_M0.7 GB
EX
Exper Alfa V1 i1
Exper · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
BE
34b beta2 i1
Beta · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
LL
Llama Phi 3 DoRA i1
Llama · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
QW
Qwen3.5 4B MultiDistill 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
OX
OxCoder 9B
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
Docto Decision Gemma 4 E4B Fr v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
AU
Aurelian v0.5 70b Rope8 32K Fp16
Aurelian · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB