GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
ON
OneJev 9B
Onejev · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
QW
Qwen2.5 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 4B RpRMax v1
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
IC
IceEspressoRPv6 i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
gpt2 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
TH
Threnystril v2.0 7B slerp
Threnystril · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GP
GPT4 X Alpasta 30b i1
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
AS
astrollama 3 8b chat aic i1
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
HO
HornyEchidna-13b-v0.1
Hornyechidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
SE
Seed X PPO 7B
Seed · mradermacher
Params7.51B
Context32K
Q4_K_M4.6 GB
AS
astrollama 2 70b chat aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
PR
PreciseCoder 4B
Precisecoder · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
IN
Index Nailong 2B
Index · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GP
Gpt Oss Sanguine 20b v1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen3 Esper3 Reasoning CODER Instruct 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context40K
Q4_K_M3.6 GB
CH
Chaotic Order V4
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Cymraeg Welsh v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB