GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
QW
Arch-Router-1.5B
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
granite-docling-258M
Granite · Mungert
Params164M
Context8K
Q4_K_M0.1 GB
DI
DiffuCoder-7B-cpGRPO
Diffucoder · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
QW
Eagle2-1B
Qwen · Mungert
Params630M
Context32K
Smallest0.4 GB
QW
OpenMath-Nemotron-14B-Kaggle
Qwen · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
KA
kani-tts-450m-0.1-pt
Kani · Mungert
Params452M
Context125K
Q4_K_M0.3 GB
PH
MediPhi-Instruct
Phi · Mungert
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Holo1-3B
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M1.9 GB
FU
functionary-small-v3.2
Functionary · Mungert
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
watt-tool-70B
Llama · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
NE
Nemotron-4-Mini-Hindi-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
HY
HyperCLOVAX-SEED-Text-Instruct-0.5B
Hyperclovax · Mungert
Params566M
Context8K
Q4_K_M0.4 GB
QW
Lucy-128k
Qwen · Mungert
Params1.72B
Context128K
Q4_K_M1.1 GB
MI
Mistral-7B-Instruct-v0.1
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
RW
rwkv7-0.4B-world
Rwkv · Mungert
Params451M
Context1024K
Q4_K_M0.3 GB
GR
granite-3.0-2b-base
Granite · Mungert
Params2.53B
Context4K
Q4_K_M1.5 GB
EX
EXAONE-Deep-2.4B
Exaone · Mungert
Params2.41B
Context32K
Q4_K_M1.5 GB
QW
QwQ-32B
Qwen · Mungert
Params32.8B
Context40K
Q4_K_M20.1 GB
QW
Cosmos-Reason1-7B
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M4.8 GB
GE
gemma-3n-E2B-it
Gemma · Mungert
Params4.46B
Context32K
Q4_K_M3.3 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
EX
EXAONE-4.0-1.2B
Exaone · Mungert
Params1.28B
Context64K
Q4_K_M0.8 GB
QW
Arch-Agent-3B
Qwen · Mungert
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
LFM2-1.2B-RAG
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
TE
TEN_Turn_Detection
Ten · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
QW
Holo1-7B
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
QW
Eagle2-9B
Qwen · Mungert
Params7.61B
Context32K
Q4_K_M4.8 GB
ME
Mellum2-12B-A2.5B-Thinking
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
RW
rwkv7-191M-world
Rwkv · Mungert
Params191M
Context1024K
Q4_K_M0.1 GB
QW
Arch-Agent-1.5B
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB