GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
Vision
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · matrixportalx
Params4.46B
Context32K
Smallest4.8 GB
Vision
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · matrixportalx
Params4.46B
Context32K
Smallest3.2 GB
Vision
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest4.2 GB
Tool use
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
Vision
LU
Lumimaid v0.2 8B
Lumimaid · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
L3 8B Stheno v3.2 Q4 0
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.1 GB
Vision
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
llama3.2 3b turkish trained
Llama · matrixportalx
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
Llama 3 VNTL Yollisa 8B
Llama · matrixportalx
Params8.03B
Context3K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B HomerCreative Mix
Qwen · matrixportalx
Params7.62B
Context32K
Q4_K_M4.7 GB
RoleplayTool use
AS
Aspire V4 8B Model Stock
Aspire · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest3.4 GB
Vision
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
LL
Emotional llama 8B Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.1 GB
Vision
LL
Llama 3.3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
GGUF
TU
Tulu 3.1 8B SuperNova Q4 K M
Tulu · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
Vision
TU
Turkce LLM
matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B CelestialHarmony 1M
Qwen · matrixportalx
Params7.61B
Context986K
Q4_K_M4.7 GB
Tool use
GE
Gemma 3 4B
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
DA
L3.1 Dark Planet SpinFire Uncensored 8B
Dark · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3 OpenBioLLM 8B Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
H the eighth 8B LINEAR
The · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3 8B Lunaris v1 Q4 0
Lunaris · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
QW
OpenR1-Qwen-7B-Turkish
Qwen · matrixportalx
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LL
Doktor Llama
Llama · matrixportalx
Params6.84B
Context4K
Q4_K_M4.2 GB
GGUF
IC
ichor 1.1 8B Model Stock
Ichor · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing