GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YA
Yafune 8B Model Stock
Yafune · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2 Turkish_F16 Gguf
Llama · matrixportalx
Params3.21B
Context128K
Smallest6.4 GB
GGUF
QW
Qwerus 7B
Qwerus · matrixportalx
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
AY
Aya Z
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NY
L3 Nymeria 8B Q8 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest8.5 GB
Roleplay
KO
Kosmos 8B v1 Q4 K M
Kosmos · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
CE
L3.1 8B Celeste V1.5 Q4 K M
Celeste · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Minitron 4B Depth Base
Llama · matrixportalx
Params4.54B
Context128K
Smallest2.7 GB
GGUF
LL
LLaMA 3 8B Instruct TR DPO Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GGUF
AY
Aya Testing Only v13
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B Q5 K S
Umbral · matrixportalx
Params8.03B
Context8K
Smallest5.6 GB
Roleplay
IN
L3.1 Instruct Guru 8B
Instruct · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
CE
L3 8B Celeste V1.2 Q5 K M
Celeste · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
GGUF
ST
Stheno Hercules 3.1 8B
Stheno · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AR
Arcee Blitz
Arcee · matrixportalx
Params23.6B
Context32K
Smallest13.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Smallest5.1 GB
GGUF
GE
Gemma 2 9b It Tr
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.8 GB
Tool use
ST
L3 SthenoMaidBlackroot 8B V1 Q3 K M
Sthenomaidblackroot · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GGUF
GE
Gemma 2b Tr Inst
Gemma · matrixportalx
Params2.51B
Context8K
Smallest1.8 GB
GGUF
MI
Mistral 7B v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.3 GB
Tool use
LL
Llama3 8B Instruct Finetuning Test_v1
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WO
WorldGen Q4 0
Worldgen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EL
Ellaria 9B Q4 0
Ellaria · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
Roleplay
PH
Phi 4 Trim
Phi · matrixportalx
Params6.14B
Context16K
Smallest3.6 GB
GGUF
LL
Llama 3.2 3B ToxicKod 0.2 Q4 0
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.9 GB
Tool use

Keep browsing