GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
SWE-Dev-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool use
SM
SmolLM2-360M-Instruct
SmolLM · Mungert
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
LF
LFM2.5 1.2B Instruct
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
GR
granite-guardian-3.2-3b-a800m
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
Tool use
QW
OpenMath-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
Reasoning
MI
AQUA-7B
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
LF
LFM2-350M-Extract
Lfm · Mungert
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
MI
Magistral-Small-2509
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
GR
granite-3.1-2b-base
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
SM
SmolLM2-135M-Instruct
SmolLM · Mungert
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
LL
Llama-3_3-Nemotron-Super-49B-v1
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.5 GB
GGUF
QW
Qwen3-0.6B
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
DE
DeepSeek-R1-0528-Qwen3-8B
DeepSeek · Mungert
Params8.19B
Context128K
Q4_K_M5.2 GB
ReasoningTool use
EX
EXAONE-Deep-7.8B
Exaone · Mungert
Params7.82B
Context32K
Q4_K_M4.9 GB
GGUF
GR
granite-3.2-8b-instruct-preview
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Jan-v1-4B
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
RW
rwkv7-0.1B-g1
Rwkv · Mungert
Params191M
Context1024K
Q4_K_M0.1 GB
Reasoning
ME
mem-agent
Mem · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LL
Llama-3.1-8B-Instruct
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
Tool use
RW
rwkv7-7.2B-g0
Rwkv · Mungert
Params7.2B
Context1024K
Q4_K_M4.6 GB
Reasoning
MI
MiMo-VL-7B-RL
Mimo · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
Tool useVision
SM
SmolLM3-3B
SmolLM · Mungert
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
TH
AM-Thinking-v1
Thinking · Mungert
Params32.8B
Context128K
Q4_K_M19.8 GB
ReasoningTool use
QW
QwQ-32B-ArliAI-RpR-v4
Qwen · Mungert
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
NU
NuMarkdown-8B-Thinking
Numarkdown · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
ReasoningVision
NE
neutts-air
Neutts · Mungert
Params748M
Context32K
Q4_K_M0.7 GB
Tool use
EX
EXAONE-4.0-32B
Exaone · Mungert
Params32B
Context128K
Q4_K_M19.5 GB
ReasoningTool use
JA
Jan-nano-128k
Jan · Mungert
Params4.02B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
QW
OlympicCoder-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
CodingReasoningTool use
NE
Nemotron-Mini-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
Tool use

Keep browsing