GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Arch-Router-1.5B
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
GR
granite-docling-258M
Granite · Mungert
Params164M
Context8K
Q4_K_M0.1 GB
CodingVision
DI
DiffuCoder-7B-cpGRPO
Diffucoder · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
CodingTool use
QW
Eagle2-1B
Qwen · Mungert
Params630M
Context32K
Smallest0.4 GB
Tool useVision
QW
OpenMath-Nemotron-14B-Kaggle
Qwen · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
Reasoning
KA
kani-tts-450m-0.1-pt
Kani · Mungert
Params452M
Context125K
Q4_K_M0.3 GB
Tool use
PH
MediPhi-Instruct
Phi · Mungert
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Holo1-3B
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
FU
functionary-small-v3.2
Functionary · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
watt-tool-70B
Llama · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
Tool use
NE
Nemotron-4-Mini-Hindi-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
Tool use
HY
HyperCLOVAX-SEED-Text-Instruct-0.5B
Hyperclovax · Mungert
Params566M
Context8K
Q4_K_M0.4 GB
GGUF
QW
Lucy-128k
Qwen · Mungert
Params1.72B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
MI
Mistral-7B-Instruct-v0.1
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RW
rwkv7-0.4B-world
Rwkv · Mungert
Params451M
Context1024K
Q4_K_M0.3 GB
GGUF
GR
granite-3.0-2b-base
Granite · Mungert
Params2.53B
Context4K
Q4_K_M1.5 GB
GGUF
EX
EXAONE-Deep-2.4B
Exaone · Mungert
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
QW
QwQ-32B
Qwen · Mungert
Params32.8B
Context40K
Q4_K_M20.1 GB
ReasoningTool use
QW
Cosmos-Reason1-7B
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
Vision
GE
gemma-3n-E2B-it
Gemma · Mungert
Params4.46B
Context32K
Q4_K_M3.3 GB
Vision
MI
Mistral-7B-Instruct-v0.3
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
EX
EXAONE-4.0-1.2B
Exaone · Mungert
Params1.28B
Context64K
Q4_K_M0.8 GB
ReasoningTool use
QW
Arch-Agent-3B
Qwen · Mungert
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
LF
LFM2-1.2B-RAG
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
Tool use
TE
TEN_Turn_Detection
Ten · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
Tool use
QW
Holo1-7B
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
Vision
QW
Eagle2-9B
Qwen · Mungert
Params7.61B
Context32K
Q4_K_M4.8 GB
Tool useVision
ME
Mellum2-12B-A2.5B-Thinking
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
ReasoningTool use
RW
rwkv7-191M-world
Rwkv · Mungert
Params191M
Context1024K
Q4_K_M0.1 GB
GGUF
QW
Arch-Agent-1.5B
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding

Keep browsing