GGUF models by liodon-ai

122 GGUF models quantized by liodon-ai on Hugging Face. Sizes run from 94M to 34.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 4B Base imatrix
Qwen · liodon-ai
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3 0.6B Base imatrix
Qwen · liodon-ai
Params596M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen2.5 Coder 3B Instruct imatrix
Qwen · liodon-ai
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen3 4B imatrix
Qwen · liodon-ai
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3 4B Thinking 2507 imatrix
Qwen · liodon-ai
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ZE
zeta 2 imatrix
Zeta · liodon-ai
Params8.25B
Context32K
Q4_K_M5.1 GB
GGUF
LL
Meta Llama 3.1 8B Instruct imatrix
Llama · liodon-ai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PH
phi 2 imatrix
Phi · liodon-ai
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
VI
vicuna 13b self consistency random var 5
Vicuna · liodon-ai
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
MiniCPM5 1B Claude Opus Fable5 Thinking imatrix
MiniCPM · liodon-ai
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · liodon-ai
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GR
granite 4.2 3b imatrix
Granite · liodon-ai
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
GR
granite 4.1 3b imatrix
Granite · liodon-ai
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
QW
Qwen3Guard Gen 4B imatrix
Qwen · liodon-ai
Params4.41B
Context32K
Q4_K_M2.7 GB
Reasoning
GR
granite 4.2 8b imatrix
Granite · liodon-ai
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
Qwen2.5 0.5B imatrix
Qwen · liodon-ai
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen2 7B Instruct imatrix
Qwen · liodon-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SM
SmolLM2 360M Instruct imatrix
SmolLM · liodon-ai
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · liodon-ai
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MY
Mythos nano imatrix
Mythos · liodon-ai
Params3.09B
Context128K
Q4_K_M1.9 GB
Tool use
MI
MiniCPM5 1B Base
MiniCPM · liodon-ai
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
G9
G9v3 3B
liodon-ai
Params2.99B
Context128K
Q4_K_M1.8 GB
ReasoningTool use
QW
Qwen2 1.5B Instruct imatrix
Qwen · liodon-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
qwen3 4b heretic imatrix
Qwen · liodon-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Qwen2.5 1.5B imatrix
Qwen · liodon-ai
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 7B Instruct imatrix
Qwen · liodon-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
VibeThinker 3B imatrix
Qwen · liodon-ai
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingTool use
MI
MiniCPM5 1B
MiniCPM · liodon-ai
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
QW
Qwen3 1.7B imatrix
Qwen · liodon-ai
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
PH
Phi 3 Mini 4k Instruct
Phi · liodon-ai
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing