GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
LL
Llama 3.1 SuperNova Lite
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · matrixportalx
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
TR
Translategemma 4b It
Translategemma · matrixportalx
Params3.88B
Context128K
Smallest2.8 GB
Vision
MI
Mistral 7B Holodeck 1
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · matrixportalx
Params3.09B
Context32K
Smallest2.5 GB
CodingTool use
UM
L3 Umbral Mind RP v3.0 8B Q5 K M
Umbral · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
Roleplay
LU
Luna 7B
Luna · matrixportalx
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest3.4 GB
Tool use
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
GGUF
LL
LLaMa 3 CursedStock v2.0 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
GGUF
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
Vision
GE
Gemma 3n E2B It
Gemma · matrixportalx
Params4.46B
Context32K
Smallest3.2 GB
Vision
LL
Pantheon RP 1.0 8b Llama 3 Q3 K M
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
Roleplay
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.9 GB
GGUF
LL
Bio Medical Llama 3 2 1B CoT 012025
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GL
GLM 4.1V Text 9B Base
GLM · matrixportalx
Params9.4B
Context32K
Smallest5.5 GB
GGUF
GL
GLM 4 9B 0414
GLM · matrixportalx
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
GE
Gemma 3 4b It
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Turkish Llama 8b Instruct v0.1
Llama · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
GGUF
TH
ThinkerLlama 3B Q4 K M
Thinkerllama · matrixportalx
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
DA
L3 Dark Planet 8B
Dark · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
Llama 3.3 8B Instruct 128K
Llama · matrixportalx
Params8.03B
Context128K
Smallest5.7 GB
Tool use

Keep browsing