GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
SA
L3 SAO MIX 8B V1 Q4 K S
Sao · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
NY
L3 Nymeria 8B Q4 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LU
L3 8B Lunaris v1 Q4 K S
Lunaris · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
DE
Decayed 8B LINEAR
Decayed · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9b It SimPO
Gemma · matrixportalx
Params9.24B
Context8K
Smallest4.5 GB
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest3.3 GB
GE
Gemma 3 270m It Tr
Gemma · matrixportalx
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest5.6 GB
LL
Llama 3 Instruct 8B SimPO
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
CE
L3.1 8B Celeste V1.5 Q4 K S
Celeste · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
NY
L3 Nymeria v2 8B Q4 K M
Nymeria · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 2b TitanFusion
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.8 GB
LL
Pantheon RP 1.0 8b Llama 3 Q4 K S
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
KO
Kosmos 8B v1 Q4 K S
Kosmos · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
AY
Aya Empati v1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
CH
L3 8B Chara v1 Alpha Q4 K M
Chara · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
UM
L3 Umbral Mind RP v0.3 8B Q4 0
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
RO
Rosa Writing 3B Q5 K M
Rosa · matrixportalx
Params2.8B
Context4K
Smallest2.0 GB
LL
FineMath Llama 3B
Llama · matrixportalx
Params3.21B
Context4K
Smallest1.9 GB
AY
Aya Medikal Test1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · matrixportalx
Params7.3B
Context4K
Q4_K_M4.5 GB
HA
Hathor Sofit L3 8B v1
Hathor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
Nymph 8B
Nymph · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mathstral 7B v0.1 Q4 0
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
LL
Llama3.2 Tr_F16
Llama · matrixportalx
Params3.21B
Context128K
Smallest6.4 GB