GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 9B Abliterated 25
Qwen · MegaPanchamZ
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
KE
Keye VL 2.0 30B A3B
Keye · Kwai-Keye
Params30.6B
Context256K
Q4_K_M18.6 GB
Vision
CL
Clover-35B-A3B-Preview
Clover · AtomicChat
Params34.7B
Context128K
Q4_K_M21.2 GB
ReasoningTool use
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
NE
nexus medical
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
OR
moziAI 35B A3B MOE MTP
Ornith · chenyumo
Params35.5B
Context256K
Q4_K_M15.9 GB
Tool useVision
QW
Qwen3.8-27B
Qwen · kcarly
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · yachiyo8080
Params177B
Context256K
Smallest66.4 GB
ReasoningTool useVision
DA
PocketDoc Dans PersonalityEngine V1.2.0 24b
Dans · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingRoleplay
SP
Spark X2.6 1.7B
Spark · XHToken
Params1.98B
Context1024K
Q4_K_M1.8 GB
ReasoningTool use
QW
Qwen3 8b Abliterated
Qwen · richardyoung
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
NE
Nex N2 Pro MTP
Nex · morikomorizz
Params403B
Context—
Smallest13.2 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.8-27B
Qwen · Fhjdjdbxhshsh
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Qwen3.5 9B
Qwen · gguf
Params9.2B
Context256K
Q4_K_M6.2 GB
Vision
QW
Qwen_Qwen3 0.6B
Qwen · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
QW
Qwen3-Coder-Next
Qwen · Mungert
Params79.7B
Context256K
Q4_K_M49.2 GB
CodingTool use
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.5 4B Uncensored
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
Qwen3.5 0.8B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
PR
PreciseCoder 27B
Precisecoder · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Coding
QW
Qwen2.5 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
QwQ 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB
Coding
GR
Granite 3.1 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
WI
Wicked Tutu 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
QW
Qwen3.8 27B Uncensored
Qwen · quuyy
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding

Keep browsing