GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
LL
Bio Medical Llama 3 8B i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
TR
Transliteration 2.0 4B Safetensors
Transliteration · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma 4 31B Fable 5 Agent Distill
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
mistral Summarizer 7b instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
AU
AuroraCap 7B IMG xtuner i1
Auroracap · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
YO
Yousei-22B
Yousei · mradermacher
Params21.8B
Context4K
Q4_K_M13.2 GB
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
YI
Configurable-Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.8 27B Ultra Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
NE
NeuralArjuna 7B DT
Neuralarjuna · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
PH
FC PHI 3.5 Mini Merged 1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
MY
MythoMax L2 13b i1
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
SEVENLLM-Llama2-7B-CoT
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
DE
DeepSeek R1 0528 Qwen3 8B Heretic
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
QW
OpenSpatial Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
llama nemotron embed 1b v2
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
IN
InfinToppyKuno DARE 7bv2
Infintoppykuno · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LF
LFM2 12B A1B SpeedDemon The Deckard II HERETIC Uncensored
Lfm · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB