GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
AY
Aya Empati v3
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
NY
L3 Nymeria 8B Q4 K S
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
AL
Alfa 1B
Alfa · matrixportalx
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
AY
Aya Empati
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
CH
Chargen v2
Chargen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
LU
Lumimaid v0.2 8B
Lumimaid · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
AY
Aya Test Model V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
LL
Llama 3 VNTL Yollisa v2 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
AY
Aya X Mod
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
PH
Phi 4 Trim Exp1
Phi · matrixportalx
Params7.5B
Context16K
Smallest4.4 GB
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Smallest9.6 GB
LL
Llama3 8B Instruct Finetuning Test_V2
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
TR
Matrixportalx · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
SK
Sky Maestro 7B Sce Q4 K S
Sky · matrixportalx
Params7.61B
Context32K
Smallest4.5 GB
SK
Sky Maestro 7B Sce Q4 0
Sky · matrixportalx
Params7.61B
Context32K
Smallest4.4 GB
GE
Gemma 2b Tr Inst
Gemma · matrixportalx
Params2.51B
Context8K
Q4_K_M1.6 GB
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
DA
L3 Dark Planet 8B V2
Dark · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB