GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
GR
Granite 34b Code Base 8k
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
Mahou-1.3a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen3.8 27B Uncensored FP8
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FO
foundational models
Foundational · sagalore-softworks
Params11.9B
Context256K
Smallest1.1 GB
QW
Qwen3.8-27B
Qwen · jakeatx
Params27.3B
Context256K
Smallest15.6 GB
QW
Qwen3 30B A3B Architect18
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
HY
Hy MT2 1.8B 2Bit
tencent
Params1.79B
Context256K
Smallest0.6 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
flux2 klein 4B uncensored text encoder
Qwen · WeReCooking
Params4B
Context40K
Smallest2.4 GB
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
qwen3 tts 0.6b base
Qwen · cstr
Params915M
Context—
Smallest0.5 GB
GE
Gemma 4 12B Unified System One
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
qwen3 coder 30b a3b compacted 19b 256k
Qwen · continuum-ai
Params19.7B
Context256K
Q4_K_M12.0 GB
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VO
voxcpm2
Voxcpm · cstr
Params2.38B
Context—
Smallest0.0 GB
QW
Qwen3 4B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Heretic Uncensored Q6 K
Qwen · mlasli
Params27.3B
Context256K
Smallest22.5 GB
KE
Kev-9B Artemis 4.1GB
Kev · turintech
Params8.96B
Context256K
Smallest4.1 GB
JA
Jan-v1-4B
Jan · janhq
Params4B
Context256K
Q4_K_M2.5 GB
KA
Kainaticulous Rp 7b
Kainaticulous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 8B JP Uncensored
Qwen · ryo559
Params8.19B
Context40K
Q4_K_M5.0 GB
WA
Wan Dancer GGUFs
Wan · realrebelai
Params17.2B
Context—
Q4_K_M12.5 GB
QW
Qwen3.5 abliterated MAX AIO
Qwen · prithivMLmods
Params752M
Context256K
Smallest0.8 GB
MU
Muse Glimmer 30B uncensored
Muse · TrevorJS
Params28B
Context128K
Q4_K_M16.9 GB