GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
L3 SAO MIX 8B V1 Q4 K S
Sao · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
NY
L3 Nymeria 8B Q4 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
LU
L3 8B Lunaris v1 Q4 K S
Lunaris · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
GGUF
DE
Decayed 8B LINEAR
Decayed · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · matrixportalx
Params9.24B
Context8K
Smallest4.5 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest3.3 GB
Tool use
GE
Gemma 3 270m It Tr
Gemma · matrixportalx
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Llama 3 Instruct 8B SimPO
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CE
L3.1 8B Celeste V1.5 Q4 K S
Celeste · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
NY
L3 Nymeria v2 8B Q4 K M
Nymeria · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 2 2b TitanFusion
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.8 GB
GGUF
LL
Pantheon RP 1.0 8b Llama 3 Q4 K S
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
KO
Kosmos 8B v1 Q4 K S
Kosmos · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
AY
Aya Empati v1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
CH
L3 8B Chara v1 Alpha Q4 K M
Chara · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
UM
L3 Umbral Mind RP v0.3 8B Q4 0
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
RO
Rosa Writing 3B Q5 K M
Rosa · matrixportalx
Params2.8B
Context4K
Smallest2.0 GB
GGUF
LL
FineMath Llama 3B
Llama · matrixportalx
Params3.21B
Context4K
Smallest1.9 GB
GGUF
AY
Aya Medikal Test1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · matrixportalx
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
HA
Hathor Sofit L3 8B v1
Hathor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
Nymph 8B
Nymph · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mathstral 7B v0.1 Q4 0
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
GGUF
LL
Llama3.2 Tr_F16
Llama · matrixportalx
Params3.21B
Context128K
Smallest6.4 GB
Tool use

Keep browsing