GGUF models by Abiray
108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.
MI
Leanstral 1.5 119B A6B
Mistral · Abiray
Params119B
Context1024K
Q4_K_M72.2 GB
LA
Laguna S 2.1 IQ4 XS Q4 K M
Laguna · Abiray
Params83.6B
Context256K
Q4_K_M75.2 GB
QW
Qwen3 VL 32B Instruct
Qwen · Abiray
Params25.8B
Context256K
Smallest12.0 GB
SU
Sutra Instruct 350M
Sutra · Abiray
Params406M
Context1K
Q4_K_M0.3 GB
QW
ThinkingCap Qwen3.6 27B Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwopus3.6 27B v1 preview
Qwopus · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ZE
Zembed 1
Zembed · Abiray
Params4.02B
Context40K
Q4_K_M2.5 GB
BI
BitCPM4 CANN 1B
Bitcpm · Abiray
Params1.62B
Context32K
Q4_K_M1.0 GB
BI
BitCPM4 CANN 0.5B
Bitcpm · Abiray
Params434M
Context32K
Q4_K_M0.3 GB
QW
ThinkingCap Qwen3.6 27B MTP Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mistral Medium 3.5 128B Q4 K M
Mistral · Abiray
Params125B
Context256K
Q4_K_M74.9 GB
BI
BitCPM4 CANN 8B
Bitcpm · Abiray
Params8.19B
Context32K
Q4_K_M5.0 GB
BI
BitCPM4 CANN 3B
Bitcpm · Abiray
Params3.61B
Context32K
Q4_K_M2.2 GB
MI
MicroLlama 134M Instruct
Microllama · Abiray
Params134M
Context1K
Smallest0.3 GB
AS
Assistant 100M Guardian
Assistant · Abiray
Params162M
Context1K
Smallest0.3 GB
AG
Agents A1
Agents · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
SE
SenseNova 6.8 Code2Video HF
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
ER
10Eros Max Turbo Beta7
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB