GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3b instruct
Mistral · matrixportalx
Params3.32B
Context128K
Smallest1.9 GB
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma3N_E4B_Tools_Test
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
SU
L3 Super Nova RP 8B
Super · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
TU
Tulu 3.1 8B SuperNova Q4 0
Tulu · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LE
Letta o1 Q4 0
Letta · matrixportalx
Params7.62B
Context32K
Smallest4.4 GB
GE
Gemma 3 12b It
Gemma · matrixportalx
Params11.8B
Context128K
Smallest6.9 GB
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest3.1 GB
SU
L3 Super Nova RP 8B
Super · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.2 Turkish
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
TH
ThinkerLlama 3B Q4 0
Thinkerllama · matrixportalx
Params3.21B
Context128K
Smallest1.9 GB
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest7.4 GB
GL
GLM 4.6V Flash
GLM · matrixportalx
Params9.4B
Context128K
Smallest5.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · matrixportalx
Params12.2B
Context128K
Smallest7.1 GB
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.2 GB
WI
Wiroai Turkish Llm 9b
Wiroai · matrixportalx
Params9.24B
Context8K
Q4_K_M5.8 GB
NO
NovaSpark Q4 K S
Novaspark · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
PR
SD Prompter 1.5B V0.1 Q8 0
Prompter · matrixportalx
Params1.54B
Context128K
Smallest1.6 GB
DE
DeepSeek Prover V1
DeepSeek · matrixportalx
Params6.91B
Context4K
Smallest4.0 GB
WI
Wiroai Turkish Llm 9b
Wiroai · matrixportalx
Params9.24B
Context8K
Smallest5.5 GB
IC
ichor 8B Model Stock
Ichor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.7 GB
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest4.5 GB
UM
L3 Umbral Mind RP v3.0 8B Q4 0
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama3 OpenBioLLM 8B Q3 K M
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · matrixportalx
Params1.54B
Context4K
Smallest1.6 GB
QW
Qwen3 14B
Qwen · matrixportalx
Params14.8B
Context40K
Smallest8.5 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.2 GB