GGUF models by matrixportalx
501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.8 GB
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Smallest3.4 GB
NO
NovaSpark Q4 0
Novaspark · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3.2 1B Instruct
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
L3 Deluxe Scrambled Eggs On Toast 8B Q4 K M
Deluxe · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen1.5 7B Turkish
Qwen · matrixportalx
Params7.72B
Context32K
Q4_K_M4.8 GB
NO
NovaSpark Q4 K M
Novaspark · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 3 12b It
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Smallest4.7 GB
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Smallest12.6 GB
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.6 GB
LL
Llama 3.2 1B Instruct
Llama · matrixportalx
Params1.24B
Context128K
Smallest0.8 GB
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
LU
Luna 8B Instruct 262k Q4 K S
Luna · matrixportalx
Params8.03B
Context256K
Smallest4.7 GB
CE
L3.1 8B Celeste V1.5 Q3 K M
Celeste · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
WO
WorldGen v2 TEST003 Q4 K M
Worldgen · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
L3 Nymeria v2 8B Q4 K S
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
LL
Turkish Llama 8b Instruct v0.1
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.4 GB
LU
L3 Luna 8B Q4 K S
Luna · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
AU
Aura MoE 2x4B v2
Aura · matrixportalx
Params7.23B
Context128K
Q4_K_M4.4 GB
GE
Gemma 4 E4B It
Gemma · matrixportalx
Params7.52B
Context128K
Smallest4.9 GB
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest3.7 GB
LL
LLaMA 3 8B Instruct TR DPO Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
Hathor Aleph L3 8B v0.72
Hathor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8b instruct tr Q4 0
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
UM
L3 Umbral Mind RP v3.0 8B Q4 K S
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB