GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
LL
shisa v1 llama3 8b
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3.2 tr
Llama · matrixportalx
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
LLama3.1 Hawkish Theia Fireball 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · matrixportalx
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Llama Spark
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
HA
hakuchido 8B MODEL STOCK
Hakuchido · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3n E2B It
Gemma · matrixportalx
Params4.46B
Context32K
Smallest2.3 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · matrixportalx
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 3.1 8B RainbowLight EtherealMix
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.7 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · matrixportalx
Params30.5B
Context256K
Smallest17.3 GB
DE
DeepSeek Prover V1.5 RL
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest7.4 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · matrixportalx
Params30.5B
Context256K
Q4_K_M18.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · matrixportalx
Params14B
Context128K
Q4_K_M8.6 GB
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Smallest6.9 GB
PH
Phi 3.5 Mini Instruct
Phi · matrixportalx
Params3.82B
Context128K
Q4_K_M2.4 GB
GE
Gemma 3 4b Tools
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
FL
flux2 klein 4b npu
Flux · matrixportalx
Params3.88B
Context—
Smallest2.3 GB
QW
Qwen2.5 Math 7B
Qwen · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
Blabbertron 1.0
Blabbertron · matrixportalx
Params7.61B
Context32K
Q4_K_M4.7 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
NA
NanoAgent 135M
Nanoagent · matrixportalx
Params135M
Context8K
Q4_K_M0.1 GB
ME
Yukselis
Metafor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
samantha mistral 7b
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3.1 BestMix Chem Einstein 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.2 GB
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Q4_K_M4.4 GB