GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
GGUF
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.6 21B IQ Ultra Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
ReasoningRoleplay
SP
Spark X2.6 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
SA
Sage A1.5
Sage · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.2B
Context8K
Q4_K_M5.8 GB
GGUF
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
BO
Boptruth Agatha 7B i1
Boptruth · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
EM
Emotion Companion 7b
Emotion · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
LI
LightOnOCR 3 4B
Lightonocr · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF

Keep browsing