GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
KI
Kimid V4A Q235 2k
Kimi · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
SO
Sorjin1.1 7B Instruct
Sorjin · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 30B A3B Thinking 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CI
Cirque 12B
Cirque · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
HE
Hemmingway 1.5 Unlocked
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GA
GameScaling 2B S3
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
NE
NeonLLM-Base
Neonllm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
NA
Nano.Imp Creative.Writing Heretic 3.2 1B
Nano · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
DE
WhiteRabbitNeo V3 7B i1
Deephat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
NA
Nanbeige4.3 33B Base
Nanbeige · mradermacher
Params33.1B
Context128K
Q4_K_M20.1 GB
AQ
Aquif 3 Moe 17b A2.8B
Aquif · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
DA
danube2-1.8b-CodeFeedback
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
PH
Phi4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Git Commit Message Splitter Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB