GGUF models by liodon-ai

122 GGUF models quantized by liodon-ai on Hugging Face. Sizes run from 94M to 34.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
fable traces imatrix
Qwen · liodon-ai
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
BL
bloomz 560m imatrix
Bloomz · liodon-ai
Params559M
Context2K
Q4_K_M0.4 GB
GGUF
WA
wav2vec2 base 960h
Wav · liodon-ai
Params94M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2.5 0.5B Instruct imatrix
Qwen · liodon-ai
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SM
SmolLM2 1.7B Instruct imatrix
SmolLM · liodon-ai
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 0.6B imatrix
Qwen · liodon-ai
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
GR
Grug 12B imatrix
Grug · liodon-ai
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
QW
Qwen3 8B imatrix
Qwen · liodon-ai
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2 0.5B Instruct imatrix
Qwen · liodon-ai
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
RE
ReaderLM v2 imatrix
Readerlm · liodon-ai
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
BL
bloom 560m imatrix
Bloom · liodon-ai
Params559M
Context1K
Q4_K_M0.4 GB
GGUF
QW
Privasis Cleaner 0.6B imatrix
Qwen · liodon-ai
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen2.5 1.5B Instruct imatrix
Qwen · liodon-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · liodon-ai
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
QW
Qwen2.5 Math 1.5B Instruct imatrix
Qwen · liodon-ai
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 Math 1.5B imatrix
Qwen · liodon-ai
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
VA
vakyansh wav2vec2 tamil tam 250
Vakyansh · liodon-ai
Params94M
Context—
Smallest0.1 GB
GGUF
WA
wav2vec2 large xlsr 53 telugu
Wav · liodon-ai
Params316M
Context—
Smallest0.2 GB
GGUF
LL
UserLM 8b imatrix
Llama · liodon-ai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WA
wav2vec2 large xlsr 53 chinese zh cn
Wav · liodon-ai
Params319M
Context—
Smallest0.2 GB
GGUF
MI
Mistral 7B Instruct v0.2 imatrix
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WA
wav2vec2 large xlsr 53 greek
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF
PH
phi 4 imatrix
Phi · liodon-ai
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GR
granite 4.1 8b imatrix
Granite · liodon-ai
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
WA
wav2vec2 large xlsr 53 russian
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF
QW
Qwen2 0.5B imatrix
Qwen · liodon-ai
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
WA
wav2vec2 large xlsr 53 portuguese
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF
WA
wav2vec2 large xlsr 53 arabic
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF
WA
wav2vec2 large xlsr 53 polish
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF
WA
wav2vec2 large xlsr 53 hungarian
Wav · liodon-ai
Params315M
Context—
Smallest0.2 GB
GGUF

Keep browsing