GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo Instruct 2407 12B Thinking HI Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AT
ATLAS 8B Thinking
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
DA
Dans AdventurousWinds 7b
Dans · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
Ph3task1 14B i1
Task · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
MO
Montebello 7B SLERP
Montebello · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
AM
AmoreLLM 4B
Amorellm · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
AN
AndroidPrincess 20B
Androidprincess · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
BO
boto 7B v1.1
Boto · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
MI
MiniCPM5 2B Abliterated Uncensored Safetensors
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Vision
NE
NeuralMaxime 7B slerp
Neuralmaxime · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.5 21B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
CodingReasoningRoleplay
RA
Rain-2x7B-MoE-32k-v0.2
Rain · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
QW
Qwen3.8 27b Noslop
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
UN
Unholy-Lewd-Emaid-Utopia-13B
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DR
Dryad 7B ties
Dryad · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
SI
Simplicio 27B
Simplicio · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Coding
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
Qwen3.8 2B Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
OPSD Qwen3 4B
Qwen · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
Reasoning

Keep browsing