GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Math 7b Rl
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · matrixportalx
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llama3 8B Instruct Turkish Finetuned
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 Turkish
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
FL
flux 3 image klein npu
Flux · matrixportalx
Params5.55B
Context256K
Smallest2.3 GB
GGUF
QW
Qwen3 VL 8B Instruct
Qwen · matrixportalx
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
GE
Gemma 3 1b It Tr v1
Gemma · matrixportalx
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · matrixportalx
Params8.03B
Context1024K
Q4_K_M4.9 GB
Roleplay
QW
Qwen3 VL 8B Instruct
Qwen · matrixportalx
Params8.19B
Context256K
Smallest5.9 GB
Tool useVision
ST
L3 8B Stheno v3.2
Stheno · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IR
iris 3b turbo npu
Iris · matrixportalx
Params2.99B
Context256K
Smallest2.3 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · matrixportalx
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
KA
Kaynak
Kaynak · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
AY
Aya TR V2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
WA
Wan2.1 T2V 1.3B npu
Wan · matrixportalx
Params5.68B
Context512
Smallest0.8 GB
GGUF
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B
DeepSeek · matrixportalx
Params4.09B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
LL
Turkish Llama3 8B Merged
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
Bio Medical 3B CoT 012025
Bio · matrixportalx
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
AY
Aya Medikal
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
FL
Flux 3 Image Klein Pup
Flux · matrixportalx
Params8.95B
Context256K
Smallest5.3 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · matrixportalx
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
TurkLlama Mix Dare_Ties
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
TurkLlama Mix
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2 Q3 K M
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest2.3 GB
Tool use

Keep browsing