GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Empati v3
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NY
L3 Nymeria 8B Q4 K S
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
AL
Alfa 1B
Alfa · matrixportalx
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
Tool use
AY
Aya Empati
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
CH
Chargen v2
Chargen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
AY
Aya Test Model V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama 3 VNTL Yollisa v2 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
Tool use
AY
Aya X Mod
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
PH
Phi 4 Trim Exp1
Phi · matrixportalx
Params7.5B
Context16K
Smallest4.4 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Smallest9.6 GB
Tool use
LL
Llama3 8B Instruct Finetuning Test_V2
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
TR
Matrixportalx · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SK
Sky Maestro 7B Sce Q4 K S
Sky · matrixportalx
Params7.61B
Context32K
Smallest4.5 GB
Tool use
SK
Sky Maestro 7B Sce Q4 0
Sky · matrixportalx
Params7.61B
Context32K
Smallest4.4 GB
Tool use
GE
Gemma 2b Tr Inst
Gemma · matrixportalx
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
GGUF
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing