GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3Vl 2b Instruct
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
SP
Spark X2.6 4B
Spark · XHToken
Params4.45B
Context1024K
Q4_K_M3.5 GB
AG
Agents A1 4B
Agents · InternScience
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
gemma 4 E2B it qat q4 0
Gemma · google
Params4.63B
Context128K
Smallest3.3 GB
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
GE
gemma 4 26B A4B it qat
Gemma · unsloth
Params430M
Context128K
Smallest0.3 GB
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · ttindall
Params27.3B
Context—
Smallest0.9 GB
QW
Qwen3 1.7B Instruct
Qwen · Qwen
Params1.72B
Context40K
Smallest1.8 GB
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
SA
Sage A1.5 Q8 0
Sage · InternScience
Params35.5B
Context256K
Smallest37.8 GB
GR
Parable Granite 4.1 3B Claude Fable 5
Granite · AnkitAI
Params3.4B
Context128K
Q4_K_M2.1 GB
GR
Parable Granite 4.1 8B Claude Fable 5
Granite · AnkitAI
Params8.38B
Context128K
Q4_K_M5.1 GB
QW
Qwen3.8 Flash Next Uncensored i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GE
gemma-4-E2B-it
Gemma · ggml-org
Params4.65B
Context128K
Smallest0.1 GB
QW
Qwen3-ASR 0.6B
Qwen · handy-computer
Params782M
Context—
Q4_K_M0.6 GB
QW
Qwen3.6 35B A3B NVFP4 MTP
Qwen · michaelw9999
Params35.5B
Context256K
Smallest20.4 GB
QW
Qwen_Qwen3.5 4B
Qwen · lmstudio-community
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.6 27B NVFP4 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
QW
Holo 3.1 35B A3B
Qwen · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
TE
Ternary Bonsai 2 27B Uncensored Heretic
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3 Embedding 0.6b
Qwen · Qwen
Params596M
Context32K
Smallest0.6 GB
HO
Diplodocus preview 4
Horizon · OsaurusAI
Params9B
Context512K
Q4_K_M6.3 GB
QW
Qwen_Qwen3.6 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus3.6 27B Coder Compat MTP
Qwopus · Jackrong
Params27B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
IM
Z Image
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
QW
Qwen Qwen3.6 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
WA
Wan2.2 I2V A14B
Wan · bullerwins
Params14.3B
Context—
Q4_K_M9.7 GB