GGUF models by Mungert
440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
LO
Logics-Parsing
Logics · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
LF
LFM2-1.2B-Extract
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
GR
granite-8b-code-base-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
GR
granite-4.0-tiny-preview
Granite · Mungert
Params6.67B
Context1024K
Q4_K_M4.2 GB
GR
granite-3b-code-instruct-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
SE
Seed-Coder-8B-Reasoning
Seed · Mungert
Params8.25B
Context64K
Q4_K_M5.2 GB
RW
RWKV7-Goose-World3-2.9B-HF
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M1.9 GB
QW
agentflow-planner-7b
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M5.0 GB
QW
olmOCR-2-7B-1025
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GR
granite-3.2-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
GR
granite-8b-code-base-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
QW
Qwen2.5-7B-Instruct
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
GR
granite-20b-code-base-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
QW
Holo-3.1-4B
Qwen · Mungert
Params4.84B
Context256K
Q4_K_M3.6 GB
QW
Josiefied-Qwen3-8B-abliterated-v1
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
QW
Qwen3 Embedding 0.6B Bf16
Qwen · Mungert
Params596M
Context32K
Q4_K_M0.4 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MU
HY-MT1.5-1.8B
Mungert · Mungert
Params1.79B
Context256K
Q4_K_M1.2 GB
GP
gpt-oss-20b-Derestricted
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
QW
Nanonets-OCR2-3B
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M2.0 GB
LL
OpenMath-CodeLlama-13b-Python-hf
Llama · Mungert
Params13B
Context16K
Q4_K_M7.8 GB
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GR
granite-8b-code-instruct-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB