GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.5 27B Writer V2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.6 21B IQ Ultra Heretic Uncensored Thinking
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
SP
Spark X2.6 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
Llama 3.3 8B Thinking Gemini Flash 11000x 128k
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
SA
Sage A1.5
Sage · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Heretic JP Roleplay NSFW DanbooruTags
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.2B
Context8K
Q4_K_M5.8 GB
LL
CodeLlama 7b Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
QW
Qwen2.5 Coder 14B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
BO
Boptruth Agatha 7B i1
Boptruth · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
EM
Emotion Companion 7b
Emotion · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 27B Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
LL
Fireball Meta Llama 3.2 8B Instruct agent 003 128k code DPO i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LI
LightOnOCR 3 4B
Lightonocr · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB