GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3b instruct
Mistral · matrixportalx
Params3.32B
Context128K
Smallest1.9 GB
GGUF
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma3N_E4B_Tools_Test
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
Tool use
SU
L3 Super Nova RP 8B
Super · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
TU
Tulu 3.1 8B SuperNova Q4 0
Tulu · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LE
Letta o1 Q4 0
Letta · matrixportalx
Params7.62B
Context32K
Smallest4.4 GB
GGUF
GE
Gemma 3 12b It
Gemma · matrixportalx
Params11.8B
Context128K
Smallest6.9 GB
Vision
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest3.1 GB
Tool use
SU
L3 Super Nova RP 8B
Super · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mistral 7B Instruct v0.2 Turkish
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
TH
ThinkerLlama 3B Q4 0
Thinkerllama · matrixportalx
Params3.21B
Context128K
Smallest1.9 GB
ReasoningTool use
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest7.4 GB
Vision
GL
GLM 4.6V Flash
GLM · matrixportalx
Params9.4B
Context128K
Smallest5.5 GB
Vision
MI
Mistral Nemo Instruct 2407
Mistral · matrixportalx
Params12.2B
Context128K
Smallest7.1 GB
Tool use
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.2 GB
GGUF
WI
Wiroai Turkish Llm 9b
Wiroai · matrixportalx
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NO
NovaSpark Q4 K S
Novaspark · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Roleplay
PR
SD Prompter 1.5B V0.1 Q8 0
Prompter · matrixportalx
Params1.54B
Context128K
Smallest1.6 GB
GGUF
DE
DeepSeek Prover V1
DeepSeek · matrixportalx
Params6.91B
Context4K
Smallest4.0 GB
GGUF
WI
Wiroai Turkish Llm 9b
Wiroai · matrixportalx
Params9.24B
Context8K
Smallest5.5 GB
GGUF
IC
ichor 8B Model Stock
Ichor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.7 GB
Vision
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest4.5 GB
Tool use
UM
L3 Umbral Mind RP v3.0 8B Q4 0
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
LL
Llama3 OpenBioLLM 8B Q3 K M
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · matrixportalx
Params1.54B
Context4K
Smallest1.6 GB
Tool use
QW
Qwen3 14B
Qwen · matrixportalx
Params14.8B
Context40K
Smallest8.5 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.2 GB
GGUF

Keep browsing