GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.1 SuperNova Lite
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · matrixportalx
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
Meta Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
TR
Translategemma 4b It
Translategemma · matrixportalx
Params3.88B
Context128K
Smallest2.8 GB
MI
Mistral 7B Holodeck 1
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · matrixportalx
Params3.09B
Context32K
Smallest2.5 GB
UM
L3 Umbral Mind RP v3.0 8B Q5 K M
Umbral · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
LU
Luna 7B
Luna · matrixportalx
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest3.4 GB
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Q4_K_M4.9 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
LL
LLaMa 3 CursedStock v2.0 8B
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2 9b It SimPO
Gemma · matrixportalx
Params9.24B
Context8K
Smallest5.4 GB
GE
Gemma 3n E4B It
Gemma · matrixportalx
Params6.87B
Context32K
Smallest4.9 GB
GE
Gemma 3n E2B It
Gemma · matrixportalx
Params4.46B
Context32K
Smallest3.2 GB
LL
Pantheon RP 1.0 8b Llama 3 Q3 K M
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.9 GB
LL
Bio Medical Llama 3 2 1B CoT 012025
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
GL
GLM 4.1V Text 9B Base
GLM · matrixportalx
Params9.4B
Context32K
Smallest5.5 GB
GL
GLM 4 9B 0414
GLM · matrixportalx
Params9.4B
Context32K
Q4_K_M6.2 GB
GE
Gemma 3 4b It
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · matrixportalx
Params8.03B
Context8K
Smallest5.7 GB
TH
ThinkerLlama 3B Q4 K M
Thinkerllama · matrixportalx
Params3.21B
Context128K
Q4_K_M2.0 GB
DA
L3 Dark Planet 8B
Dark · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3.3 8B Instruct 128K
Llama · matrixportalx
Params8.03B
Context128K
Smallest5.7 GB