GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
shisa v1 llama3 8b
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3.2 tr
Llama · matrixportalx
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
LLama3.1 Hawkish Theia Fireball 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 30B A3B Thinking 2507
Qwen · matrixportalx
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
LL
Llama Spark
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
HA
hakuchido 8B MODEL STOCK
Hakuchido · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Gemma 3n E2B It
Gemma · matrixportalx
Params4.46B
Context32K
Smallest2.3 GB
Vision
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · matrixportalx
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama 3.1 8B RainbowLight EtherealMix
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest3.7 GB
Tool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · matrixportalx
Params30.5B
Context256K
Smallest17.3 GB
Tool use
DE
DeepSeek Prover V1.5 RL
DeepSeek · matrixportalx
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Smallest7.4 GB
Vision
QW
Qwen3 30B A3B Instruct 2507
Qwen · matrixportalx
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use
PH
Phi 3 Medium 128k Instruct
Phi · matrixportalx
Params14B
Context128K
Q4_K_M8.6 GB
Coding
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Smallest6.9 GB
Vision
PH
Phi 3.5 Mini Instruct
Phi · matrixportalx
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
GE
Gemma 3 4b Tools
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
Tool useVision
FL
flux2 klein 4b npu
Flux · matrixportalx
Params3.88B
Context—
Smallest2.3 GB
GGUF
QW
Qwen2.5 Math 7B
Qwen · matrixportalx
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BL
Blabbertron 1.0
Blabbertron · matrixportalx
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
GGUF
NA
NanoAgent 135M
Nanoagent · matrixportalx
Params135M
Context8K
Q4_K_M0.1 GB
CodingTool use
ME
Yukselis
Metafor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
samantha mistral 7b
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3.1 BestMix Chem Einstein 8B
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.2 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · matrixportalx
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing