GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
AE
AesCode 8B
Aescode · bartowski
Params8.19B
Context256K
Q4_K_M5.2 GB
CodingVision
HU
Ornith 1.5 35B A3B Abliterated
Huihui · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
Vision
MO
MOSS Image
Moss · molbal
Params5.08B
Context—
Q4_K_M3.6 GB
GGUF
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Gemma 4 Dark Orthia Untied 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
QW
Sugoi 32B Ultra
Qwen · sugoitoolkit
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma 4 Dark Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
BA
Bathory X 26B A4B 0.2
Bathory · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GGUF
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FA
FastWan2.2 TI2V 5B FullAttn
Fastwan · Green-Sky
Params5B
Context—
Smallest4.2 GB
GGUF
GR
Granite 3.3 8b Instruct
Granite · ibm-granite
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
MiniCPM V 4
MiniCPM · openbmb
Params3.6B
Context32K
Q4_K_M2.2 GB
CodingVision
GE
gemma 4 31B it uncensored
Gemma · TrevorJS
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · lumen-models
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1
Qwen · IsValorum
Params35.5B
Context256K
Smallest1.2 GB
ReasoningTool useVision
MO
moondream2
Moondream · ggml-org
Params1.42B
Context2K
Smallest2.8 GB
Vision
IM
Z-Image-Engineer-V6-SMART-DoRA-StyleBlendV9-25V17-75
Image · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
Coding
QW
Qwen3.8 27B BaseQuant V1
Qwen · basecompute
Params27.3B
Context256K
Smallest8.4 GB
ReasoningTool use
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
GGUF
RW
Rwkv 6 World 7b
Rwkv · latestissue
Params7.64B
Context1024K
Smallest3.0 GB
GGUF
KE
Kev 9B
Kev · ggml-org
Params9B
Context256K
Q4_K_M6.4 GB
GGUF
HO
K2-Horizon-32B
Horizon · bartowski
Params34.8B
Context512K
Q4_K_M22.0 GB
GGUF
QW
Qwen3.5 27B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Qwen3.8 Flash Next Uncensored UD Q4 K XL
Qwen · NeosQ
Params177B
Context256K
Smallest4.1 GB
ReasoningTool useVision
GR
Granite-4.0-H-Tiny
Granite · unsloth
Params6.94B
Context1024K
Q4_K_M4.3 GB
GGUF
QW
Qwen3 VL 8B Instruct Uncensored V2
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision

Keep browsing