GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SW
Swallow-13b-instruct-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
DE
Josiefied DeepSeek R1 0528 Qwen3 8B Abliterated v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Reranker 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
RU
MN 12B Runeweaver RP RU
Runeweaver · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.8 27B MindMeld OneJev1.6
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
PU
L3.1 Purosani i1
Purosani · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
ToolACE 2.5 Llama 3.1 8B Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
GrayLine Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AL
AllOverButTheCrying-7B-slerp
Alloverbutthecrying · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
RedSage Qwen3 8B Ins
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3.5 4b Agentic Coder v4
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
DR
DrakIdol Roleplayer 1.0
Drakidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
AT
Athene codegemma 2 7b it alpaca v1.3 i1
Athene · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Writing_Partner_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
Polaris VGA 27B Post1.0e
Polaris · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ST
Starcoderbase
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
BI
Bielik 7B Instruct v0.1
Bielik · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
DO
DonutHole-8x7B
Donuthole · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
NE
Neural AlphaMistral 7B
Neural · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 2 Theta Llama 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · mradermacher
Params16.5B
Context128K
Q4_K_M10.0 GB