GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
Roleplay
MI
Mahou-1.3a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
FO
foundational models
Foundational · sagalore-softworks
Params11.9B
Context256K
Smallest1.1 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · jakeatx
Params27.3B
Context256K
Smallest15.6 GB
GGUF
QW
Qwen3 30B A3B Architect18
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningRoleplayTool use
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HY
Hy MT2 1.8B 2Bit
tencent
Params1.79B
Context256K
Smallest0.6 GB
GGUF
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
GGUF
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
flux2 klein 4B uncensored text encoder
Qwen · WeReCooking
Params4B
Context40K
Smallest2.4 GB
Coding
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Coding
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
GGUF
GE
Gemma 4 12B Unified System One
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
CodingEmbeddingTool use
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Roleplay
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
VO
voxcpm2
Voxcpm · cstr
Params2.38B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 4B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params4B
Context256K
Q4_K_M2.5 GB
Roleplay
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3.8 27B Heretic Uncensored Q6 K
Qwen · mlasli
Params27.3B
Context256K
Smallest22.5 GB
Roleplay
KE
Kev-9B Artemis 4.1GB
Kev · turintech
Params8.96B
Context256K
Smallest4.1 GB
ReasoningTool use
JA
Jan-v1-4B
Jan · janhq
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
KA
Kainaticulous Rp 7b
Kainaticulous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Qwen3 8B JP Uncensored
Qwen · ryo559
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
WA
Wan Dancer GGUFs
Wan · realrebelai
Params17.2B
Context—
Q4_K_M12.5 GB
GGUF
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
Vision
MU
Muse Glimmer 30B uncensored
Muse · TrevorJS
Params28B
Context128K
Q4_K_M16.9 GB
Vision

Keep browsing