GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
QW
Qwen3-1.7B
Qwen · Mungert
Params2.03B
Context40K
Q4_K_M1.4 GB
XL
xLAM-2-32b-fc-r
Xlam · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
GR
granite-guardian-3.0-8b
Granite · Mungert
Params8.17B
Context8K
Q4_K_M4.9 GB
LF
LFM2-1.2B-Tool
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
MI
lucid-v1-nemo
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.6 GB
NE
Nex-N2-mini
Nex · Mungert
Params34.7B
Context256K
Q4_K_M21.8 GB
GE
medgemma-4b-pt
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
MU
HY-MT1.5-7B
Mungert · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
YO
Youtu-LLM-2B
Youtu · Mungert
Params1.96B
Context128K
Q4_K_M1.3 GB
QW
Qwen3-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
RE
Refact-1_6B-fim
Refact · Mungert
Params1.59B
Context4K
Q4_K_M1.0 GB
QW
Qwen3-30B-A1.5B-High-Speed
Qwen · Mungert
Params30.5B
Context40K
Q4_K_M18.9 GB
NE
Nemotron-Cascade-2-30B-A3B
Nemotron · Mungert
Params31.6B
Context1024K
Q4_K_M23.9 GB
DE
DeepMedix-R1
Deepmedix · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GR
granite-4.0-h-tiny
Granite · Mungert
Params6.94B
Context1024K
Q4_K_M4.3 GB
QW
Eagle2-2B
Qwen · Mungert
Params1.78B
Context32K
Q4_K_M1.2 GB
EX
EXAONE-Deep-32B
Exaone · Mungert
Params32B
Context32K
Q4_K_M19.3 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
AC
AceMath-7B-Instruct
Acemath · Mungert
Params7.62B
Context4K
Q4_K_M4.8 GB
DE
DeepSeek-R1-Distill-Qwen-7B
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Polaris-4B-Preview
Qwen · Mungert
Params4.02B
Context128K
Q4_K_M2.5 GB
QW
Qwen3-Reranker-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
QW
Aryabhata-1.0
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
MI
MiniCPM5-1B
MiniCPM · Mungert
Params1.08B
Context128K
Q4_K_M0.8 GB
GR
granite-3.1-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
GE
gemma-3-27b-it
Gemma · Mungert
Params27B
Context128K
Q4_K_M16.5 GB
LL
Llama-2-7b-chat-hf
Llama · Mungert
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
granite-4.0-1b
Granite · Mungert
Params1.63B
Context128K
Q4_K_M1.1 GB
GR
granite-3.0-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context4K
Q4_K_M4.9 GB