GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.61B
Context128K
Smallest1.5 GB
YU
YuLan Mini
Yulan · matrixportalx
Params2.42B
Context28K
Smallest2.6 GB
LL
Llama 2 7b Chat Hf
Llama · matrixportalx
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
CE
L3.1 8B Celeste V1.5 Q2 K
Celeste · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
GE
Gemma 3 4b Tools
Gemma · matrixportalx
Params3.88B
Context128K
Smallest2.4 GB
WI
wiroai turkish llm 8b Q4 K M
Wiroai · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3b instruct Q5 K M
Mistral · matrixportalx
Params3.32B
Context128K
Smallest2.3 GB
LU
L3 Luna 8B Q4 K M
Luna · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest3.8 GB
CU
CursedMatrix 8B v9
Cursedmatrix · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
Self Forcing T2V 1.3B npu
Self · matrixportalx
Params1.42B
Context—
Smallest0.8 GB
NO
Noxis 8B LINEAR
Noxis · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stablelm Zephyr 3b
Stablelm · matrixportalx
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Llama 3.1 8B SuperTulu LexiNova
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
TR
Translategemma 4b It
Translategemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
BU
Buttocks 7B v1.1
Buttocks · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
NA
NanoAgent 135M
Nanoagent · matrixportalx
Params135M
Context8K
Smallest0.1 GB
NY
L3 Nymeria v2 8B Q4 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
AS
Astral 1 2B
Astral · matrixportalx
Params2.61B
Context8K
Smallest2.2 GB
LL
llama 3.2b hf 32768 IQ4 NL
Llama · matrixportalx
Params3.18B
Context32K
Smallest1.8 GB
MI
Ministral 3b instruct Q5 K S
Mistral · matrixportalx
Params3.32B
Context128K
Smallest2.3 GB
TA
L3 8B Tamamo v1 Q4 K M
Tamamo · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
L3 Luna 8B Q4 0
Luna · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
RO
Rosa Writing 3B Q4 K M
Rosa · matrixportalx
Params2.8B
Context4K
Q4_K_M1.7 GB
YU
YuLan Mini
Yulan · matrixportalx
Params2.42B
Context28K
Smallest1.5 GB
LL
Llama 3.1 8B SpecialTitanFusion Q4 0
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB