GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
QW
Qwen3.8-27B
Qwen · Mungert
Params27.3B
Context256K
Q4_K_M17.5 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
GE
gemma-4-E4B-it
Gemma · Mungert
Params7.52B
Context128K
Q4_K_M6.2 GB
LI
A.X-4.0-Light
Light · Mungert
Params7.26B
Context16K
Q4_K_M4.5 GB
QW
Qwen2.5-VL-32B-Instruct
Qwen · Mungert
Params32.8B
Context125K
Q4_K_M20.1 GB
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
AP
Apriel-1.5-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
QW
Qwen2.5-Omni-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.2 GB
QI
Qianfan-OCR
Qianfan · Mungert
Params4.42B
Context32K
Q4_K_M3.1 GB
RW
Rwkv7 2.9B G1
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M2.0 GB
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
TR
Trinity-Nano-Preview
Trinity · Mungert
Params6.12B
Context128K
Q4_K_M4.0 GB
QW
Qwen3-VL-30B-A3B-Instruct
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
QW
AesCoder-4B
Qwen · Mungert
Params4.41B
Context256K
Q4_K_M3.0 GB
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
QW
Qwen3-1.7B-abliterated
Qwen · Mungert
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3-0.6B-abliterated
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
GL
Glyph
GLM · Mungert
Params9.4B
Context128K
Q4_K_M6.6 GB
QW
Qwen3-VL-4B-Instruct
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
LL
Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
GI
GigaChat3-10B-A1.8B
Gigachat · Mungert
Params10.7B
Context256K
Q4_K_M6.7 GB
LF
LFM2.5-Audio-1.5B
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen2.5-1.5B-Instruct
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB