GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 4B
Qwen · empero-ai
Params4.33B
Context256K
Q4_K_M2.8 GB
Reasoning
QW
Qwen3Vl 4b Instruct
Qwen · Qwen
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · nerkyor
Params27.3B
Context256K
Smallest3.2 GB
CodingReasoningTool use
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
QW
Qwen_Qwen3.5 9B
Qwen · lmstudio-community
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
NO
nomic-embed-text-v1.5
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
QW
Qwen3.8-27B-Uncensored-Cyber
Qwen · philbert440
Params27B
Context256K
Q4_K_M19.0 GB
Vision
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3.8 9B
Qwen · empero-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Reasoning
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
DA
POCKET 35B
Darwin · FINAL-Bench
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
UM
Umt5 Xxl
Umt · city96
Params5.68B
Context512
Q4_K_M3.7 GB
Coding
QW
Qwen3.8 27B OBLITERATED
Qwen · OBLITERATUS
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
AD
AdaVaR 3B
Adavar · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
ReasoningTool useVision
QW
Qwen3.8 2B
Qwen · empero-ai
Params1.94B
Context256K
Q4_K_M1.3 GB
Reasoning
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Ternary Bonsai 27B
Qwen · prism-ml
Params3.6B
Context4K
Smallest1.9 GB
Vision
QW
Qwen3.8 27B Fable 5 Coding Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningVision
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
GE
Gemma 4 E4B
Gemma · lmstudio-community
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
MI
Voxtral Mini 4B Realtime
Mistral · handy-computer
Params4.43B
Context—
Q4_K_M2.8 GB
GGUF
OR
Ornith 1.5 35B A3B APEX MTP
Ornith · mudler
Params447M
Context256K
Smallest14.4 GB
Vision
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
AP
Apodex 1.1 Mini
Apodex · abenzerps
Params35.5B
Context256K
Q4_K_M19.8 GB
Vision
WH
Whisper Large v3
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored IQ3 S Strata
Qwen · jimmy31chen
Params177B
Context256K
Smallest88.9 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision

Keep browsing