GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MP
Mpt 7b 8k Chat
Mpt · mradermacher
Params6.65B
Context8K
Q4_K_M4.3 GB
Coding
KA
KangalKhan Alpha Rubyroid 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Tool use
LL
Llama 3.1 EIRAI 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NO
NovaSage 24B
Novasage · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
OL
OLMoE-1B-7B-0125-Instruct-Distill-ot114k-batch32
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
Reasoning
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
AR
arco reflection v4
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
OM
OmniCoder 2 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
DA
danube2-1.8b-Neural
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
MI
Gukbap Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
PII Model Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
Qwen 2.5 3b Decensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
RE
RedSage K SFT GRPO
Redsage · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
Tool use
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
LL
Llama 3.1 8B Lexi Uncensored V2 OBLITERATED
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ST
Step3 VL 10B Base
Step · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
GP
GPT4 X Alpasta 30b
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
JO
JoyFox-Reverie-27B
Joyfox · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
QW
Qwen3 VL 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
MA
Lh41 1042 Magellanic 7B 0711
Magellanic · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
LO
lobe3 i1
Lobe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
HU
Hunyuan 7B Instruct
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Huihui Qwen3 Omni 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Qwen3.5 9B RpRMax v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
HU
Huihui HY MT1.5 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
HU
HuatuoGPT 3 8B
Huatuogpt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing