GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
Vision
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
Vision
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma-4-E4B-it
Gemma · Mungert
Params7.52B
Context128K
Q4_K_M6.2 GB
ReasoningTool use
LI
A.X-4.0-Light
Light · Mungert
Params7.26B
Context16K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5-VL-32B-Instruct
Qwen · Mungert
Params32.8B
Context125K
Q4_K_M20.1 GB
Vision
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
Reasoning
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
Vision
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
Reasoning
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
GGUF
QI
Qianfan-OCR
Qianfan · Mungert
Params4.42B
Context32K
Q4_K_M3.1 GB
ReasoningVision
RW
Rwkv7 2.9B G1
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M2.0 GB
Reasoning
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
TR
Trinity-Nano-Preview
Trinity · Mungert
Params6.12B
Context128K
Q4_K_M4.0 GB
Tool use
QW
Qwen3-VL-30B-A3B-Instruct
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
Tool useVision
QW
AesCoder-4B
Qwen · Mungert
Params4.41B
Context256K
Q4_K_M3.0 GB
CodingReasoningTool use
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
ReasoningTool useVision
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
ReasoningTool useVision
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Qwen3-1.7B-abliterated
Qwen · Mungert
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
ReasoningTool useVision
QW
Qwen3-VL-4B-Instruct
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
Tool useVision
LL
Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
ReasoningRoleplayTool use
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool useVision
GI
GigaChat3-10B-A1.8B
Gigachat · Mungert
Params10.7B
Context256K
Q4_K_M6.7 GB
Tool use
LF
LFM2.5-Audio-1.5B
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
Qwen2.5-1.5B-Instruct
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB
ReasoningTool use

Keep browsing