GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
QW
UIGEN-X-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
QW
SWE-agent-LM-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
QwenLong-L1.5-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
GP
gpt-oss-20b-heretic
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
QW
Qwen3.5-2B
Qwen · Mungert
Params1.88B
Context256K
Q4_K_M1.3 GB
SK
SkyCaptioner-V1
Skycaptioner · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
LF
LFM2-2.6B-Transcript
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
FO
Foundation-Sec-8B-Instruct
Foundation · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
LL
OpenMath-CodeLlama-7b-Python-hf
Llama · Mungert
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Schematron-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3-16B-A3B
Qwen · Mungert
Params16B
Context40K
Q4_K_M10.0 GB
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB
QW
Qwopus3.5 9B Coder
Qwopus · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
QW
Qwen3Guard-Gen-8B
Qwen · Mungert
Params8.19B
Context32K
Q4_K_M5.1 GB
ME
Mellum2-12B-A2.5B-Instruct
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
MA
maya1
Maya · Mungert
Params3.3B
Context128K
Q4_K_M2.2 GB
QW
Qwen3-14B-abliterated
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.2 GB
MI
Devstral-Small-2505
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
KA
kani-tts-400m-en
Kani · Mungert
Params370M
Context125K
Q4_K_M0.3 GB
QW
Qwen3.5-4B
Qwen · Mungert
Params4.21B
Context256K
Q4_K_M2.8 GB
GE
google_gemma-3-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
DA
DASD-4B-Thinking
Dasd · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB