GGUF models by Mungert

440 GGUF models quantized by Mungert on Hugging Face. Sizes run from 23M to 360B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
LO
Logics-Parsing
Logics · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GGUF
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
LF
LFM2-1.2B-Extract
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
GGUF
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
GR
granite-8b-code-base-128k
Granite · Mungert
Params8.05B
Context125K
Q4_K_M4.8 GB
Coding
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
ReasoningTool use
GR
granite-4.0-tiny-preview
Granite · Mungert
Params6.67B
Context1024K
Q4_K_M4.2 GB
ReasoningTool use
GR
granite-3b-code-instruct-2k
Granite · Mungert
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
SE
Seed-Coder-8B-Reasoning
Seed · Mungert
Params8.25B
Context64K
Q4_K_M5.2 GB
CodingReasoning
RW
RWKV7-Goose-World3-2.9B-HF
Rwkv · Mungert
Params2.95B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
agentflow-planner-7b
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M5.0 GB
Tool use
QW
olmOCR-2-7B-1025
Qwen · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
Vision
GR
granite-3.2-8b-instruct
Granite · Mungert
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
GR
granite-8b-code-base-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
Coding
QW
Qwen2.5-7B-Instruct
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
Tool use
GR
granite-20b-code-base-8k
Granite · Mungert
Params20.1B
Context8K
Q4_K_M12.6 GB
Coding
QW
Holo-3.1-4B
Qwen · Mungert
Params4.84B
Context256K
Q4_K_M3.6 GB
ReasoningTool useVision
QW
Josiefied-Qwen3-8B-abliterated-v1
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.1 GB
ReasoningTool use
QW
Qwen3 Embedding 0.6B Bf16
Qwen · Mungert
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
MU
HY-MT1.5-1.8B
Mungert · Mungert
Params1.79B
Context256K
Q4_K_M1.2 GB
GGUF
GP
gpt-oss-20b-Derestricted
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
GGUF
QW
Nanonets-OCR2-3B
Qwen · Mungert
Params3.09B
Context125K
Q4_K_M2.0 GB
Vision
LL
OpenMath-CodeLlama-13b-Python-hf
Llama · Mungert
Params13B
Context16K
Q4_K_M7.8 GB
Coding
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
ReasoningTool use
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
CodingReasoningTool use
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
GGUF
FA
Fara-7B
Fara · Mungert
Params7.62B
Context125K
Q4_K_M5.0 GB
GGUF
GR
granite-8b-code-instruct-4k
Granite · Mungert
Params8.05B
Context4K
Q4_K_M4.8 GB
CodingTool use

Keep browsing