GGUF models by Abiray

108 GGUF models quantized by Abiray on Hugging Face. Sizes run from 134M to 197B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Leanstral 1.5 119B A6B
Mistral · Abiray
Params119B
Context1024K
Q4_K_M72.2 GB
CodingTool use
LA
Laguna S 2.1 IQ4 XS Q4 K M
Laguna · Abiray
Params83.6B
Context256K
Q4_K_M75.2 GB
CodingReasoningTool use
QW
Qwen3 VL 32B Instruct
Qwen · Abiray
Params25.8B
Context256K
Smallest12.0 GB
Vision
SU
Sutra Instruct 350M
Sutra · Abiray
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
QW
ThinkingCap Qwen3.6 27B Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwopus3.6 27B v1 preview
Qwopus · Abiray
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
ZE
Zembed 1
Zembed · Abiray
Params4.02B
Context40K
Q4_K_M2.5 GB
EmbeddingReasoningTool use
BI
BitCPM4 CANN 1B
Bitcpm · Abiray
Params1.62B
Context32K
Q4_K_M1.0 GB
GGUF
BI
BitCPM4 CANN 0.5B
Bitcpm · Abiray
Params434M
Context32K
Q4_K_M0.3 GB
GGUF
QW
ThinkingCap Qwen3.6 27B MTP Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
Mistral Medium 3.5 128B Q4 K M
Mistral · Abiray
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
BI
BitCPM4 CANN 8B
Bitcpm · Abiray
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
BI
BitCPM4 CANN 3B
Bitcpm · Abiray
Params3.61B
Context32K
Q4_K_M2.2 GB
GGUF
MI
MicroLlama 134M Instruct
Microllama · Abiray
Params134M
Context1K
Smallest0.3 GB
GGUF
AS
Assistant 100M Guardian
Assistant · Abiray
Params162M
Context1K
Smallest0.3 GB
GGUF
AG
Agents A1
Agents · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
SE
SenseNova 6.8 Code2Video HF
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
ReasoningTool useVision
ER
10Eros Max Turbo Beta7
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF

Keep browsing