GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
Multilingual SaigaSuzume 8B Q4 K S
Multilingual · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
QW
Qwen2.5 7B HomerFuse NerdExp Q4 0
Qwen · matrixportalx
Params7.61B
Context32K
Smallest4.4 GB
Tool use
MI
Ministral 3b instruct Q4 K S
Mistral · matrixportalx
Params3.32B
Context128K
Smallest1.9 GB
GGUF
LL
Llama 3.2 1B
Llama · matrixportalx
Params1.24B
Context128K
Smallest1.3 GB
GGUF
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
Llama 3 Instruct 8B SimPO
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.3 GB
Tool use
KO
InfectedKosmos 8B v1
Kosmos · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 4 E4B It
Gemma · matrixportalx
Params7.52B
Context128K
Smallest5.2 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Reasoning
LL
Emotional llama 8B Q4 K S
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
RO
L3.2 Rogue Creative Instruct 7B
Rogue · matrixportalx
Params7.14B
Context128K
Smallest4.1 GB
Tool use
LL
Pantheon RP 1.0 8b Llama 3 Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
WO
Char Assistant TEST Q4 0
Worldgen · matrixportalx
Params7.24B
Context32K
Smallest4.1 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
GGUF
LL
LLaMA 3 8B Instruct Abliterated TR Q4 0
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
GGUF
LL
Llama 3.2 3B Bespoke Thought
Llama · matrixportalx
Params3.21B
Context128K
Smallest3.4 GB
Tool use
CE
L3 8B Celeste v1 Q4 K S
Celeste · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B BookAdventures
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
AY
Aya X Yeni
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Smallest3.2 GB
GGUF
EU
EuroLLM 1.7B Instruct Q8 0
Eurollm · matrixportalx
Params1.66B
Context4K
Smallest1.8 GB
GGUF
NI
L3 8B Niitama v1 Q4 K M
Niitama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
Eurus 2 7B PRIME
Eurus · matrixportalx
Params7.62B
Context4K
Smallest4.5 GB
GGUF
GL
GLM 4.1V 9B Base
GLM · matrixportalx
Params9.4B
Context64K
Smallest5.5 GB
ReasoningVision
RO
L3.2 Rogue Creative Instruct Uncensored 7B
Rogue · matrixportalx
Params7.53B
Context128K
Smallest4.4 GB
Tool use

Keep browsing