GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
YA
Yafune 8B Model Stock
Yafune · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.2 Turkish_F16 Gguf
Llama · matrixportalx
Params3.21B
Context128K
Smallest6.4 GB
QW
Qwerus 7B
Qwerus · matrixportalx
Params7.62B
Context128K
Q4_K_M4.7 GB
AY
Aya Z
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
NY
L3 Nymeria 8B Q8 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest8.5 GB
KO
Kosmos 8B v1 Q4 K M
Kosmos · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
CE
L3.1 8B Celeste V1.5 Q4 K M
Celeste · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Minitron 4B Depth Base
Llama · matrixportalx
Params4.54B
Context128K
Smallest2.7 GB
LL
LLaMA 3 8B Instruct TR DPO Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
AY
Aya Testing Only v13
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
UM
L3 Umbral Mind RP v3.0 8B Q5 K S
Umbral · matrixportalx
Params8.03B
Context8K
Smallest5.6 GB
IN
L3.1 Instruct Guru 8B
Instruct · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
CE
L3 8B Celeste V1.2 Q5 K M
Celeste · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
ST
Stheno Hercules 3.1 8B
Stheno · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
AR
Arcee Blitz
Arcee · matrixportalx
Params23.6B
Context32K
Smallest13.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Smallest5.1 GB
GE
Gemma 2 9b It Tr
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.8 GB
ST
L3 SthenoMaidBlackroot 8B V1 Q3 K M
Sthenomaidblackroot · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GE
Gemma 2b Tr Inst
Gemma · matrixportalx
Params2.51B
Context8K
Smallest1.8 GB
MI
Mistral 7B v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Smallest4.1 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.3 GB
LL
Llama3 8B Instruct Finetuning Test_v1
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
WO
WorldGen Q4 0
Worldgen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
LL
Llama 3.1 SuperNova Lite
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
EL
Ellaria 9B Q4 0
Ellaria · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
PH
Phi 4 Trim
Phi · matrixportalx
Params6.14B
Context16K
Smallest3.6 GB
LL
Llama 3.2 3B ToxicKod 0.2 Q4 0
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.9 GB