GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
LL
Llama-3.2-3B-Instruct
Llama · Mungert
Params3.21B
Context128K
Q4_K_M2.0 GB
GR
granite-3b-code-base-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
PL
PLM-1.8B-Instruct
Plm · Mungert
Params1.83B
Context4K
Q4_K_M1.2 GB
LI
Lingshu-32B
Lingshu · Mungert
Params32.8B
Context125K
Q4_K_M19.8 GB
GR
granite-20b-functioncalling
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
ME
MedScholar-1.5B
Medscholar · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
OpenReasoning-Nemotron-1.5B
Qwen · Mungert
Params1.54B
Context128K
Q4_K_M1.0 GB
GR
granite-guardian-3.1-2b
Granite · Mungert
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
typhoon-ocr-7b
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
AL
all-MiniLM-L6-v2
All · Mungert
Params23M
Context512
Q4_K_M0.0 GB
LL
Llama-3.2-3B-F1-Reasoning-Instruct
Llama · Mungert
Params3.61B
Context128K
Q4_K_M2.3 GB
GR
granite-3.1-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
ME
MetaStone-L1-7B
Metastone · Mungert
Params7.62B
Context128K
Q4_K_M4.7 GB
LF
LFM2.5-1.2B-Thinking
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Nanonets-OCR2-1.5B-exp
Qwen · Mungert
Params982M
Context32K
Q4_K_M0.7 GB
GE
sarvam-translate
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Arch-Agent-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
GE
Gemma-3-Gaia-PT-BR-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
DeepHermes-3-Llama-3-8B-Preview
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.1 GB
GR
granite-guardian-3.2-5b
Granite · Mungert
Params5.78B
Context128K
Q4_K_M3.5 GB
GR
granite-3.0-1b-a400m-base
Granite · Mungert
Params1.38B
Context4K
Smallest0.6 GB
NE
Nemotron-4-Mini-Hindi-4B-Base
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
GR
granite-3.1-1b-a400m-instruct
Granite · Mungert
Params1.33B
Context128K
Smallest0.5 GB
GR
granite-4.0-350m
Granite · Mungert
Params352M
Context32K
Q4_K_M0.3 GB
LL
Meta-Llama-3-8B
Llama · Mungert
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
UIGEN-T2-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
MI
Wayfarer-2-12B
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.9 GB
MA
MAI-UI-8B
Mai · Mungert
Params8.19B
Context256K
Q4_K_M5.4 GB
QW
LiveCC-7B-Instruct
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
QW
OpenCodeReasoning-Nemotron-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB