GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Llama 8B Abliterated Q4 K M
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GE
Gemma 3 270m It Tr
Gemma · matrixportalx
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
IM
z image turbo npu
Image · matrixportalx
Params6.15B
Context—
Smallest2.3 GB
GGUF
PH
phi 4 Q2 K
Phi · matrixportalx
Params14.7B
Context16K
Smallest5.5 GB
Coding
LL
LLaMA 3 8B Instruct Abliterated TR Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · matrixportalx
Params1.54B
Context32K
Smallest1.6 GB
Tool use
BE
Ben Maya
Ben · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest5.7 GB
Vision
LL
Llama 3.3 8B Instruct 128K
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
GGUF
AS
Aspire 8B model stock
Aspire · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3.1 TheiaFire DarkFusion 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingReasoningRoleplay
GE
Gemma 3n E4B It Less Heretic
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
Vision
GP
Huihui Gpt Oss 20b BF16 Abliterated v2
gpt-oss · matrixportalx
Params20.9B
Context128K
Smallest12.1 GB
GGUF
EM
EmojiLlama 3.1 8B
Emojillama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Bio Medical Llama 3 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EU
EurusPRM Stage2
Eurusprm · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
QW
Qwen2 VL 2B Instruct
Qwen · matrixportalx
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest4.4 GB
Tool use
ST
L3 8B Stheno v3.3 32K
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.0 GB
GGUF
MI
MiMo VL 7B RL 2508
Mimo · matrixportalx
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
DA
Daredevil 8B
Daredevil · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
Maya
Maya · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
GE
Gemma 3n E4B It Less Heretic
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Smallest4.7 GB
Tool use
AY
Aya TR V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
QW
Qwen3 VL 4B Instruct Heretic
Qwen · matrixportalx
Params4.02B
Context256K
Smallest3.3 GB
CodingVision

Keep browsing