GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
Tool useVision
QW
UIGEN-X-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
ReasoningTool use
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
EmbeddingTool use
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
QW
SWE-agent-LM-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool use
QW
QwenLong-L1.5-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool use
GP
gpt-oss-20b-heretic
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
Tool use
QW
Qwen3.5-2B
Qwen · Mungert
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
SK
SkyCaptioner-V1
Skycaptioner · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
Tool use
LF
LFM2-2.6B-Transcript
Lfm · Mungert
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
FO
Foundation-Sec-8B-Instruct
Foundation · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
GGUF
MI
Midm-2.0-Base-Instruct
Midm · Mungert
Params11.5B
Context32K
Q4_K_M7.1 GB
Tool use
LL
OpenMath-CodeLlama-7b-Python-hf
Llama · Mungert
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Schematron-3B
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3-16B-A3B
Qwen · Mungert
Params16B
Context40K
Q4_K_M10.0 GB
GGUF
QW
Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2
Qwen · Mungert
Params9.2B
Context256K
Q4_K_M6.6 GB
ReasoningTool useVision
QW
Qwopus3.5 9B Coder
Qwopus · Mungert
Params9.2B
Context256K
Q4_K_M6.1 GB
CodingReasoningTool use
QW
Qwen3Guard-Gen-8B
Qwen · Mungert
Params8.19B
Context32K
Q4_K_M5.1 GB
Reasoning
ME
Mellum2-12B-A2.5B-Instruct
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
Tool use
MA
maya1
Maya · Mungert
Params3.3B
Context128K
Q4_K_M2.2 GB
Tool use
QW
Qwen3-14B-abliterated
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.2 GB
GGUF
MI
Devstral-Small-2505
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
KA
kani-tts-400m-en
Kani · Mungert
Params370M
Context125K
Q4_K_M0.3 GB
Tool use
QW
Qwen3.5-4B
Qwen · Mungert
Params4.21B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
GE
google_gemma-3-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GR
granite-3b-code-base-128k
Granite · Mungert
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
LL
KernelLLM
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
GGUF
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
GGUF
KA
KAT-Dev
Kat · Mungert
Params32.8B
Context128K
Q4_K_M20.2 GB
GGUF
DA
DASD-4B-Thinking
Dasd · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use

Keep browsing