GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.61B
Context128K
Smallest1.5 GB
Tool use
YU
YuLan Mini
Yulan · matrixportalx
Params2.42B
Context28K
Smallest2.6 GB
Coding
LL
Llama 2 7b Chat Hf
Llama · matrixportalx
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
GGUF
CE
L3.1 8B Celeste V1.5 Q2 K
Celeste · matrixportalx
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GE
Gemma 3 4b Tools
Gemma · matrixportalx
Params3.88B
Context128K
Smallest2.4 GB
Tool useVision
WI
wiroai turkish llm 8b Q4 K M
Wiroai · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Ministral 3b instruct Q5 K M
Mistral · matrixportalx
Params3.32B
Context128K
Smallest2.3 GB
GGUF
LU
L3 Luna 8B Q4 K M
Luna · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest3.8 GB
GGUF
CU
CursedMatrix 8B v9
Cursedmatrix · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SE
Self Forcing T2V 1.3B npu
Self · matrixportalx
Params1.42B
Context—
Smallest0.8 GB
GGUF
NO
Noxis 8B LINEAR
Noxis · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · matrixportalx
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
Llama 3.1 8B SuperTulu LexiNova
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TR
Translategemma 4b It
Translategemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
BU
Buttocks 7B v1.1
Buttocks · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NA
NanoAgent 135M
Nanoagent · matrixportalx
Params135M
Context8K
Smallest0.1 GB
CodingTool use
NY
L3 Nymeria v2 8B Q4 0
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
AS
Astral 1 2B
Astral · matrixportalx
Params2.61B
Context8K
Smallest2.2 GB
GGUF
LL
llama 3.2b hf 32768 IQ4 NL
Llama · matrixportalx
Params3.18B
Context32K
Smallest1.8 GB
GGUF
MI
Ministral 3b instruct Q5 K S
Mistral · matrixportalx
Params3.32B
Context128K
Smallest2.3 GB
GGUF
TA
L3 8B Tamamo v1 Q4 K M
Tamamo · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
L3 Luna 8B Q4 0
Luna · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
RO
Rosa Writing 3B Q4 K M
Rosa · matrixportalx
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
YU
YuLan Mini
Yulan · matrixportalx
Params2.42B
Context28K
Smallest1.5 GB
Coding
LL
Llama 3.1 8B SpecialTitanFusion Q4 0
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use

Keep browsing