GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
MU
Multilingual SaigaSuzume 8B Q4 K S
Multilingual · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen2.5 7B HomerFuse NerdExp Q4 0
Qwen · matrixportalx
Params7.61B
Context32K
Smallest4.4 GB
MI
Ministral 3b instruct Q4 K S
Mistral · matrixportalx
Params3.32B
Context128K
Smallest1.9 GB
LL
Llama 3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Smallest1.3 GB
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest3.8 GB
LL
Llama 3 Instruct 8B SimPO
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.3 GB
KO
InfectedKosmos 8B v1
Kosmos · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 E4B It
Gemma · matrixportalx
Params7.52B
Context128K
Smallest5.2 GB
LL
Llama 3.1 Storm 8B
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LL
Emotional llama 8B Q4 K S
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
RO
L3.2 Rogue Creative Instruct 7B
Rogue · matrixportalx
Params7.14B
Context128K
Smallest4.1 GB
LL
Pantheon RP 1.0 8b Llama 3 Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
WO
Char Assistant TEST Q4 0
Worldgen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
LL
LLaMA 3 8B Instruct Abliterated TR Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
LL
Llama 3.2 3B Bespoke Thought
Llama · matrixportalx
Params3.21B
Context128K
Smallest3.4 GB
CE
L3 8B Celeste v1 Q4 K S
Celeste · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3.1 8B BookAdventures
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
AY
Aya X Yeni
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Smallest3.2 GB
EU
EuroLLM 1.7B Instruct Q8 0
Eurollm · matrixportalx
Params1.66B
Context4K
Smallest1.8 GB
NI
L3 8B Niitama v1 Q4 K M
Niitama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
Eurus 2 7B PRIME
Eurus · matrixportalx
Params7.62B
Context4K
Smallest4.5 GB
GL
GLM 4.1V 9B Base
GLM · matrixportalx
Params9.4B
Context64K
Smallest5.5 GB
RO
L3.2 Rogue Creative Instruct Uncensored 7B
Rogue · matrixportalx
Params7.53B
Context128K
Smallest4.4 GB