GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
DA
MN DARKEST UNIVERSE 29B
Darkest · DavidAU
Params29.2B
Context1000K
Q4_K_M17.6 GB
QW
ThinkingCap Qwen3.6 27B abliterated MTP
Qwen · protoLabsAI
Params27.3B
Context—
Q4_K_M16.8 GB
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB
KA
KAT Coder V2.5 Dev 35B A3B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Kat · PhillyLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
LI
LightOnOCR 3 1B
Lightonocr · prithivMLmods
Params596M
Context16K
Q4_K_M0.4 GB
CO
Cohere Transcribe 03-2026
Cohere · cstr
Params2.07B
Context—
Smallest1.3 GB
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Irwan LightOnOCR 3 0.8B Abliterated
Qwen · irwanworld
Params752M
Context256K
Smallest0.8 GB
OL
Olmo-3-7B-Instruct
OLMo · unsloth
Params7.3B
Context64K
Q4_K_M4.5 GB
QW
Qwen3 4B Instruct 2507 Heretic
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
IN
index echo 2b
Index · cstr
Params1.88B
Context—
Smallest0.7 GB
GR
Granite-4.0-350M
Granite · unsloth
Params352M
Context32K
Q4_K_M0.2 GB
QW
Qwen Image 2512
Qwen · Frederic75
Params20.4B
Context—
Q4_K_M13.0 GB
QW
qwen image edit multiple angles
Qwen · ChrisColeTech
Params20.4B
Context—
Q4_K_M11.7 GB
NA
Nanbeige4.2 3B
Nanbeige · owao
Params4.17B
Context256K
Q4_K_M2.6 GB
WI
Wicked Stuff 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6 27B Uncensored Heretic v2
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
QW
Bonsai 2 27B 1bit CRACK
Qwen · dealignai
Params27B
Context256K
Smallest5.9 GB
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · CISCai
Params32.8B
Context32K
Smallest7.3 GB
DA
L3 DARKEST PLANET 16.5B
Darkest · DavidAU
Params16.5B
Context8K
Q4_K_M10.2 GB
QW
Qwen3.8 27B Optimal Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · bartowski
Params32.8B
Context125K
Q4_K_M19.9 GB
IN
index echo 9b
Index · cstr
Params8.95B
Context—
Smallest1.3 GB
QW
Qwen3.6 14B A3B VibeForged v2
Qwen · tvall43
Params13.8B
Context256K
Q4_K_M8.5 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB