GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CA
Carnice MoE 35B A3B
Carnice · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
MI
Flirty Mistral
Mistral · mradermacher
Params7.3B
Context32K
Q4_K_M4.4 GB
WO
WorldSim Opus 3.6 35B A3B
Worldsim · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 4B Instruct 2507 Heretic v4
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
NI
Q3 Nilcall 32B v0.1
Nilcall · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
TR
Triangulum 5B It
Triangulum · mradermacher
Params5.41B
Context8K
Q4_K_M3.4 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated Obliteratus
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
ReSearch Qwen 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
AT
Athena-CodePhi-7B-4k-v0.1
Athena · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
NE
NeuralGanesha 7b
Neuralganesha · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
SP
Spark X2.6 4B Tema_Q Abliterated
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
GE
Gemma 4 12B It QAT SOMPOA Heresy
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E4B It Erotica
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
LL
Llama 3.1 Storm 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaDA 1.5
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
JA
Javi0.3 4B
Javi · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GE
Huihui Gemma 4 12B Coder Fable5 Composer2.5 v1 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 Psychological Reasoning 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
DR
Draco 8x7B
Draco · mradermacher
Params46.7B
Context8K
Q4_K_M28.6 GB
QW
BiggerCoQ Qwen3 10b
Qwen · mradermacher
Params10.9B
Context40K
Q4_K_M6.6 GB
SI
InnerJev 27B Full
Sii · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AT
Athena-CodeZephyr-7B-v0.2
Athena · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB