GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
DarkSapling 7B v2.0
Darksapling · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Dolphin 3.0 Llama 3.1 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2 7B
Qwen · matrixportalx
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
TO
Toprak
Toprak · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.61B
Context128K
Smallest1.9 GB
Tool use
MI
Ministral 3b instruct Q4 K M
Mistral · matrixportalx
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
DO
Doruk
Doruk · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
RO
L3.2 Rogue Creative Instruct Uncensored Abliterated 7B
Rogue · matrixportalx
Params7.53B
Context128K
Smallest4.4 GB
Tool use
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · matrixportalx
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
QW
Qwen3 30B A3B Instruct 2507
Qwen · matrixportalx
Params30.5B
Context256K
Smallest21.7 GB
Tool use
ST
L3 8B Stheno Horny v3.3 32K Q4 K S
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.7 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
LL
Profesor Dare_Ties
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.9 GB
GGUF
QW
Qwen3 VL 4B Instruct Heretic
Qwen · matrixportalx
Params4.02B
Context256K
Smallest2.4 GB
CodingVision
FL
flux1 schnell npu
Flux · matrixportalx
Params11.9B
Context512
Smallest2.9 GB
GGUF
CL
ClimateLlama 8B TR
Climatellama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
GE
Gemma 3n E4B It Less Heretic
Gemma · matrixportalx
Params6.87B
Context32K
Smallest5.7 GB
Vision
AS
L3 Aspire Heart Matrix 8B
Aspire · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen 2.5 7b S1k
Qwen · matrixportalx
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RU
Rusted Gold 8B LINEAR
Rusted · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
DA
L3 Dark Planet 8B
Dark · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
ReaderLM v2
Readerlm · matrixportalx
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
ST
L3 8B Stheno v3.2 Q4 K S
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
HE
Heart Stolen 8B Model Stock
Heart · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing