GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
KI
Kimid V4A Q235 2k
Kimi · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Tool use
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
SO
Sorjin1.1 7B Instruct
Sorjin · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
Qwen3 30B A3B Thinking 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
CI
Cirque 12B
Cirque · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GA
GameScaling 2B S3
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool useVision
NE
NeonLLM-Base
Neonllm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Tool use
NA
Nano.Imp Creative.Writing Heretic 3.2 1B
Nano · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
DE
WhiteRabbitNeo V3 7B i1
Deephat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
NA
Nanbeige4.3 33B Base
Nanbeige · mradermacher
Params33.1B
Context128K
Q4_K_M20.1 GB
GGUF
AQ
Aquif 3 Moe 17b A2.8B
Aquif · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
CodingReasoning
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
DA
danube2-1.8b-CodeFeedback
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Coding
PH
Phi4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Git Commit Message Splitter Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF

Keep browsing