GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
qwen2-1_5b-instruct
Qwen · Qwen
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.8 27B Uncensored FIT
Qwen · SC117
Params27B
Context256K
Smallest7.5 GB
Vision
NA
Nanbeige4.3 33B
Nanbeige · abenzerps
Params33.1B
Context512K
Smallest9.9 GB
ReasoningTool use
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Smallest12.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5-9B
Qwen · weareapexcreators
Params9.2B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen2.5 7b Ins v3
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
OR
Ornith 1.0 35B
Ornith · weareapexcreators
Params34.7B
Context1024K
Smallest12.9 GB
GGUF
MI
MinerU2.5 Pro 2605 1.2B
Mineru · jinzhenj
Params494M
Context8K
Smallest0.5 GB
Vision
WA
WaifuGemma4 26b a4b v1 i1
Waifugemma · hiwaifu-research
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
speakoflow mini
Qwen · SpeakoFlow
Params773M
Context256K
Q4_K_M0.5 GB
GGUF
BA
Bamboo 1 LocalAI
Bamboo · weareapexcreators
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Qwen3.8 27B S mirai
Qwen · alesha-pro
Params27B
Context—
Smallest0.0 GB
GGUF
OR
Ornith 1.0 9B MTP LocalAI
Ornith · weareapexcreators
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
MI
vllm-d3-mini
Mini · ggml-org
Params4.84B
Context256K
Q4_K_M3.7 GB
Vision
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · ggml-org
Params30.5B
Context256K
Q4_K_M18.0 GB
CodingTool use
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 VL 8B Instruct Abliterated v2.0
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
QW
Qwen3.8 27B Omnimerge v6
Qwen · ManniX-ITA
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen Image Edit 2509
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Mica v0.1 4B
Qwen · sky7350
Params4.84B
Context256K
Q4_K_M3.1 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · douganger
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Ministral-3-14B-Instruct-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
Vision
OP
opendecider small
Opendecider · manjunathshiva
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
LocalAI functioncall qwen2.5 7b v0.5 Q4 K M
Qwen · LocalAI-io
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing