GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
DA
MN DARKEST UNIVERSE 29B
Darkest · DavidAU
Params29.2B
Context1000K
Q4_K_M17.6 GB
Roleplay
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
Reasoning
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB
GGUF
KA
KAT Coder V2.5 Dev 35B A3B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Kat · PhillyLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingTool useVision
LI
LightOnOCR 3 1B
Lightonocr · prithivMLmods
Params596M
Context16K
Q4_K_M0.4 GB
Vision
CO
Cohere Transcribe 03-2026
Cohere · cstr
Params2.07B
Context—
Smallest1.3 GB
GGUF
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
QW
Irwan LightOnOCR 3 0.8B Abliterated
Qwen · irwanworld
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
OL
Olmo-3-7B-Instruct
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
IN
index echo 2b
Index · cstr
Params1.88B
Context—
Smallest0.7 GB
GGUF
GR
Granite-4.0-350M
Granite · unsloth
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
QW
Qwen Image 2512
Qwen · Frederic75
Params20.4B
Context—
Q4_K_M13.0 GB
GGUF
QW
qwen image edit multiple angles
Qwen · ChrisColeTech
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
NA
Nanbeige4.2 3B
Nanbeige · owao
Params4.17B
Context256K
Q4_K_M2.6 GB
GGUF
WI
Wicked Stuff 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.6 27B Uncensored Heretic v2
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Bonsai 2 27B 1bit CRACK
Qwen · dealignai
Params27B
Context256K
Smallest5.9 GB
GGUF
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
Reasoning
QW
Qwen2.5 Coder 32B Instruct
Qwen · CISCai
Params32.8B
Context32K
Smallest7.3 GB
Coding
DA
L3 DARKEST PLANET 16.5B
Darkest · DavidAU
Params16.5B
Context8K
Q4_K_M10.2 GB
Roleplay
QW
Qwen3.8 27B Optimal Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
IN
index echo 9b
Index · cstr
Params8.95B
Context—
Smallest1.3 GB
GGUF
QW
Qwen3.6 14B A3B VibeForged v2
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB
Vision
QW
Qwen3 30B A3B Thinking 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning

Keep browsing