GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
SP
Spark-X2.6-4B
Spark · Mungert
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
Vision
OL
Olmo-3-7B-Instruct
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Tool use
NA
Nanbeige4.1-3B
Nanbeige · Mungert
Params3.93B
Context256K
Q4_K_M2.6 GB
GGUF
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
Vision
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
ReasoningRoleplayTool use
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
GGUF
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
GGUF
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
CodingReasoning
GR
granite-4.0-h-micro
Granite · Mungert
Params3.2B
Context1024K
Q4_K_M2.0 GB
GGUF
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
Vision
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
GGUF
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
Vision
QW
Qwen3-Reranker-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.5 GB
Embedding
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
GGUF
QW
Huihui-Qwen3.5-9B-abliterated
Qwen · Mungert
Params8.95B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
Vision
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
Reasoning
QW
s1-mini
Qwen · Mungert
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
GE
gemma-4-E2B-it
Gemma · Mungert
Params4.65B
Context128K
Q4_K_M4.1 GB
ReasoningTool use
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3-VL-8B-Instruct
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
Vision
LL
llama-joycaption-beta-one-hf-llava
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
Tool useVision
JA
AI21-Jamba-Reasoning-3B
Jamba · Mungert
Params3.2B
Context256K
Q4_K_M2.0 GB
ReasoningTool use
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB
GGUF

Keep browsing