GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MP
Mpt 7b 8k Chat
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
KA
KangalKhan Alpha Rubyroid 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.1 EIRAI 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
NO
NovaSage 24B
Novasage · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
OL
OLMoE-1B-7B-0125-Instruct-Distill-ot114k-batch32
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
AR
arco reflection v4
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
OM
OmniCoder 2 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DA
danube2-1.8b-Neural
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
MI
Gukbap Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
PII Model Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
Qwen 2.5 3b Decensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
RE
RedSage K SFT GRPO
Redsage · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
LL
Llama 3.1 8B Lexi Uncensored V2 OBLITERATED
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ST
Step3 VL 10B Base
Step · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GP
GPT4 X Alpasta 30b
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 VL 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MA
Lh41 1042 Magellanic 7B 0711
Magellanic · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LO
lobe3 i1
Lobe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
HU
Hunyuan 7B Instruct
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Huihui Qwen3 Omni 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Qwen3.5 9B RpRMax v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HU
Huihui HY MT1.5 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
HU
HuatuoGPT 3 8B
Huatuogpt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB