GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
QW
SWE-Dev-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
SM
SmolLM2-360M-Instruct
SmolLM · Mungert
Params362M
Context8K
Q4_K_M0.3 GB
LF
LFM2.5 1.2B Instruct
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
GR
granite-guardian-3.2-3b-a800m
Granite · Mungert
Params3.3B
Context128K
Smallest1.2 GB
QW
OpenMath-Nemotron-32B
Qwen · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
MI
AQUA-7B
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
LF
LFM2-350M-Extract
Lfm · Mungert
Params354M
Context125K
Q4_K_M0.2 GB
MI
Magistral-Small-2509
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
GR
granite-3.1-2b-base
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
SM
SmolLM2-135M-Instruct
SmolLM · Mungert
Params135M
Context8K
Q4_K_M0.1 GB
LL
Llama-3_3-Nemotron-Super-49B-v1
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.5 GB
QW
Qwen3-0.6B
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
DE
DeepSeek-R1-0528-Qwen3-8B
DeepSeek · Mungert
Params8.19B
Context128K
Q4_K_M5.2 GB
EX
EXAONE-Deep-7.8B
Exaone · Mungert
Params7.82B
Context32K
Q4_K_M4.9 GB
GR
granite-3.2-8b-instruct-preview
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
QW
Jan-v1-4B
Qwen · Mungert
Params4.02B
Context256K
Q4_K_M2.6 GB
RW
rwkv7-0.1B-g1
Rwkv · Mungert
Params191M
Context1024K
Q4_K_M0.1 GB
ME
mem-agent
Mem · Mungert
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
Llama-3.1-8B-Instruct
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
RW
rwkv7-7.2B-g0
Rwkv · Mungert
Params7.2B
Context1024K
Q4_K_M4.6 GB
MI
MiMo-VL-7B-RL
Mimo · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
SM
SmolLM3-3B
SmolLM · Mungert
Params3.08B
Context64K
Q4_K_M1.9 GB
TH
AM-Thinking-v1
Thinking · Mungert
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
QwQ-32B-ArliAI-RpR-v4
Qwen · Mungert
Params32.8B
Context40K
Q4_K_M19.8 GB
NU
NuMarkdown-8B-Thinking
Numarkdown · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
NE
neutts-air
Neutts · Mungert
Params748M
Context32K
Q4_K_M0.7 GB
EX
EXAONE-4.0-32B
Exaone · Mungert
Params32B
Context128K
Q4_K_M19.5 GB
JA
Jan-nano-128k
Jan · Mungert
Params4.02B
Context128K
Q4_K_M2.5 GB
QW
OlympicCoder-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
NE
Nemotron-Mini-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB