GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MI
Mistral Nemo Instruct 2407 12B Thinking HI Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AT
ATLAS 8B Thinking
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
DA
Dans AdventurousWinds 7b
Dans · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
Ph3task1 14B i1
Task · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
MO
Montebello 7B SLERP
Montebello · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
AM
AmoreLLM 4B
Amorellm · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
AN
AndroidPrincess 20B
Androidprincess · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
BO
boto 7B v1.1
Boto · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
MI
MiniCPM5 2B Abliterated Uncensored Safetensors
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
NE
NeuralMaxime 7B slerp
Neuralmaxime · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.5 21B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
RA
Rain-2x7B-MoE-32k-v0.2
Rain · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen3.8 27b Noslop
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
UN
Unholy-Lewd-Emaid-Utopia-13B
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
DR
Dryad 7B ties
Dryad · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
SI
Simplicio 27B
Simplicio · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8 2B Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
OPSD Qwen3 4B
Qwen · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB