GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
AceMath-RL-Nemotron-7B
Nemotron · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
SM
SmolLM2-1.7B-Instruct
SmolLM · Mungert
Params1.71B
Context8K
Q4_K_M1.0 GB
GGUF
LI
LightOnOCR-1B-1025
Lightonocr · Mungert
Params752M
Context8K
Q4_K_M0.6 GB
Vision
QW
Pantheon-Proto-RP-1.8-30B-A3B
Qwen · Mungert
Params30.5B
Context32K
Q4_K_M18.9 GB
Roleplay
DE
Nemotron-Research-Reasoning-Qwen-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
ReasoningTool use
QW
Qwen3.5-27B
Qwen · Mungert
Params26.9B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
QW
Qwen3-32B
Qwen · Mungert
Params32.8B
Context40K
Q4_K_M20.0 GB
ReasoningTool use
KA
kanana-1.5-8b-instruct-2505
Kanana · Mungert
Params8.03B
Context32K
Q4_K_M5.0 GB
Tool use
QW
Qwen3-4B
Qwen · Mungert
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
ER
ERNIE-4.5-0.3B-PT
Ernie · Mungert
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
QW
Skywork-VL-Reward-7B
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
Tool useVision
QW
olmOCR-7B-0225-preview
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
GR
granite-3.1-3b-a800m-instruct
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
Tool use
QW
OpenReasoning-Nemotron-14B
Qwen · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoning
LL
OpenMath2-Llama3.1-8B
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
Tool use
GP
gpt-oss-safeguard-20b
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M11.9 GB
Tool use
SO
SoulX-Podcast-1.7B
Soulx · Mungert
Params2.06B
Context40K
Q4_K_M1.5 GB
GGUF
DE
ZR1-1.5B
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
CodingReasoningTool use
QW
OpenThinker3-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
Tool use
HU
Hunyuan-7B-Instruct
Hunyuan · Mungert
Params7.5B
Context256K
Q4_K_M4.7 GB
GGUF
QW
OpenCodeReasoning-Nemotron-14B
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.1 GB
CodingReasoningTool use
GE
X-Ray_Alpha
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
RW
rwkv7-1.5B-g1
Rwkv · Mungert
Params1.53B
Context1024K
Q4_K_M1.0 GB
Reasoning
MA
Magma-8B
Magma · Mungert
Params8.03B
Context8K
Q4_K_M5.0 GB
Vision
GP
gpt2
Gpt · Mungert
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Lucy
Qwen · Mungert
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
ME
II-Medical-8B-1706
Medical · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
GGUF
QW
OpenReasoning-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
CodingReasoning
AG
M3-Agent-Control
Agent · Mungert
Params32.8B
Context40K
Q4_K_M20.2 GB
ReasoningTool use
SY
sychonix
Sychonix · Mungert
Params109M
Context512
Q4_K_M0.1 GB
GGUF

Keep browsing