GGUF models by matrixportalx

501 GGUF models quantized by matrixportalx on Hugging Face. Sizes run from 78M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest2.8 GB
GGUF
GE
Gemma 4 E2B It
Gemma · matrixportalx
Params4.65B
Context128K
Smallest3.4 GB
GGUF
NO
NovaSpark Q4 0
Novaspark · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Roleplay
LL
Llama 3.2 1B Instruct
Llama · matrixportalx
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
DE
L3 Deluxe Scrambled Eggs On Toast 8B Q4 K M
Deluxe · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
QW
Qwen1.5 7B Turkish
Qwen · matrixportalx
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
NO
NovaSpark Q4 K M
Novaspark · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
GE
Gemma 3 12b It
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 2 2b
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.6 GB
GGUF
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Ministral 8B Instruct 2410
Mistral · matrixportalx
Params8.02B
Context32K
Smallest4.7 GB
Tool use
MI
Mistral Small Instruct 2409
Mistral · matrixportalx
Params22.2B
Context32K
Smallest12.6 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · matrixportalx
Params3.21B
Context128K
Smallest1.6 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · matrixportalx
Params1.24B
Context128K
Smallest0.8 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
Tool use
LU
Luna 8B Instruct 262k Q4 K S
Luna · matrixportalx
Params8.03B
Context256K
Smallest4.7 GB
GGUF
CE
L3.1 8B Celeste V1.5 Q3 K M
Celeste · matrixportalx
Params8.03B
Context128K
Smallest4.0 GB
GGUF
WO
WorldGen v2 TEST003 Q4 K M
Worldgen · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
L3 Nymeria v2 8B Q4 K S
Nymeria · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay
LL
Turkish Llama 8b Instruct v0.1
Llama · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
GE
Gemma 2 2b It
Gemma · matrixportalx
Params2.61B
Context8K
Smallest1.4 GB
GGUF
LU
L3 Luna 8B Q4 K S
Luna · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
AU
Aura MoE 2x4B v2
Aura · matrixportalx
Params7.23B
Context128K
Q4_K_M4.4 GB
RoleplayTool use
GE
Gemma 4 E4B It
Gemma · matrixportalx
Params7.52B
Context128K
Smallest4.9 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · matrixportalx
Params8.03B
Context8K
Smallest3.7 GB
GGUF
LL
LLaMA 3 8B Instruct TR DPO Q4 K M
Llama · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Hathor Aleph L3 8B v0.72
Hathor · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8b instruct tr Q4 0
Llama · matrixportalx
Params8.03B
Context128K
Smallest4.7 GB
Tool use
UM
L3 Umbral Mind RP v3.0 8B Q4 K S
Umbral · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
Roleplay

Keep browsing