GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-1.7B
Qwen · Mungert
Params2.03B
Context40K
Q4_K_M1.4 GB
ReasoningTool use
XL
xLAM-2-32b-fc-r
Xlam · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
GR
granite-guardian-3.0-8b
Granite · Mungert
Params8.17B
Context8K
Q4_K_M4.9 GB
GGUF
LF
LFM2-1.2B-Tool
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
Tool use
MI
lucid-v1-nemo
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.6 GB
GGUF
NE
Nex-N2-mini
Nex · Mungert
Params34.7B
Context256K
Q4_K_M21.8 GB
ReasoningTool use
GE
medgemma-4b-pt
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
MU
HY-MT1.5-7B
Mungert · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
GGUF
YO
Youtu-LLM-2B
Youtu · Mungert
Params1.96B
Context128K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen3-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
ReasoningTool use
RE
Refact-1_6B-fim
Refact · Mungert
Params1.59B
Context4K
Q4_K_M1.0 GB
Coding
QW
Qwen3-30B-A1.5B-High-Speed
Qwen · Mungert
Params30.5B
Context40K
Q4_K_M18.9 GB
ReasoningTool use
NE
Nemotron-Cascade-2-30B-A3B
Nemotron · Mungert
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool use
DE
DeepMedix-R1
Deepmedix · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
ReasoningTool use
GR
granite-4.0-h-tiny
Granite · Mungert
Params6.94B
Context1024K
Q4_K_M4.3 GB
Tool use
QW
Eagle2-2B
Qwen · Mungert
Params1.78B
Context32K
Q4_K_M1.2 GB
Tool useVision
EX
EXAONE-Deep-32B
Exaone · Mungert
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
AC
AceMath-7B-Instruct
Acemath · Mungert
Params7.62B
Context4K
Q4_K_M4.8 GB
GGUF
DE
DeepSeek-R1-Distill-Qwen-7B
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Polaris-4B-Preview
Qwen · Mungert
Params4.02B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Qwen3-Reranker-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
EmbeddingReasoningTool use
QW
Aryabhata-1.0
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
Tool use
MI
MiniCPM5-1B
MiniCPM · Mungert
Params1.08B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
GR
granite-3.1-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GE
gemma-3-27b-it
Gemma · Mungert
Params27B
Context128K
Q4_K_M16.5 GB
Vision
LL
Llama-2-7b-chat-hf
Llama · Mungert
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
granite-4.0-1b
Granite · Mungert
Params1.63B
Context128K
Q4_K_M1.1 GB
Tool use
GR
granite-3.0-8b-lora-intrinsics-v0.1
Granite · Mungert
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use

Keep browsing