GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
SP
Spark-X2.6-4B
Spark · Mungert
Params4.11B
Context1024K
Q4_K_M2.6 GB
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
OL
Olmo-3-7B-Instruct
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
NA
Nanbeige4.1-3B
Nanbeige · Mungert
Params3.93B
Context256K
Q4_K_M2.6 GB
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
GR
granite-4.0-h-micro
Granite · Mungert
Params3.2B
Context1024K
Q4_K_M2.0 GB
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
QW
Huihui-Qwen3.5-9B-abliterated
Qwen · Mungert
Params8.95B
Context256K
Q4_K_M6.0 GB
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GE
gemma-4-E2B-it
Gemma · Mungert
Params4.65B
Context128K
Q4_K_M4.1 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3-VL-8B-Instruct
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB