GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
DE
DeepSeek R1 Distill Llama 8B Abliterated Q4 K M
DeepSeek · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3 270m It Tr
Gemma · matrixportalx
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
IM
z image turbo npu
Image · matrixportalx
Params6.15B
Context—
Smallest2.3 GB
PH
phi 4 Q2 K
Phi · matrixportalx
Params14.7B
Context16K
Smallest5.5 GB
LL
LLaMA 3 8B Instruct Abliterated TR Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 1.5B Instruct
Qwen · matrixportalx
Params1.54B
Context32K
Smallest1.6 GB
BE
Ben Maya
Ben · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest5.7 GB
LL
Llama 3.3 8B Instruct 128K
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 9b It
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
AS
Aspire 8B model stock
Aspire · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3.1 TheiaFire DarkFusion 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3n E4B It Less Heretic
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
GP
Huihui Gpt Oss 20b BF16 Abliterated v2
gpt-oss · matrixportalx
Params20.9B
Context128K
Smallest12.1 GB
EM
EmojiLlama 3.1 8B
Emojillama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Bio Medical Llama 3 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
EurusPRM Stage2
Eurusprm · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
Qwen2 VL 2B Instruct
Qwen · matrixportalx
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Qwen2.5 7B Instruct
Qwen · matrixportalx
Params7.62B
Context32K
Smallest4.4 GB
ST
L3 8B Stheno v3.3 32K
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.0 GB
MI
MiMo VL 7B RL 2508
Mimo · matrixportalx
Params7.62B
Context125K
Q4_K_M4.7 GB
DA
Daredevil 8B
Daredevil · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
Maya
Maya · matrixportalx
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
Gemma 3n E4B It Less Heretic
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Smallest4.7 GB
AY
Aya TR V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
QW
Qwen3 VL 4B Instruct Heretic
Qwen · matrixportalx
Params4.02B
Context256K
Smallest3.3 GB