GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
JA
Jais-3-MoVA-36B-A4B
Jais · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NI
Ninja-v1-NSFW-RP
Ninja · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
HU
HuatuoGPT O1 7B
Huatuogpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
HU
Huihui LFM2.5 8B A1B Abliterated
Huihui · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GR
granite 20b code instruct i1
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GU
GUI Owl 1.5 2B Instruct
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
MP
Mpt 7b Storywriter
Mpt · mradermacher
Params6.65B
Context64K
Q4_K_M4.3 GB
NO
Nous Capybara limarpv3 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
LI
Linne Oak 1 0
Linne · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GE
Gemma 4 26B A4B
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
PY
Pythia 12b Deduped
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
WI
Wicked Stuff 26B A4B v3.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
XY
Xyntetik Kvist 14B
Xyntetik · mradermacher
Params14.4B
Context128K
Q4_K_M10.3 GB
HO
K2-Horizon-3.7B
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
OM
Omega Arsenal 12B
Omega · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
LL
Llama 7B rollercoaster v2 i1
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LU
Lunar Huntress 0.1
Lunar · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB