GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
GGUF
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · Andycurrent
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GR
Granite 4.1 8b
Granite · ibm-granite
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.1 GB
Vision
QW
qwen2-0_5b-instruct
Qwen · Qwen
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GP
OpenAI Gpt Oss 20B Claude 4.5 Opus Heretic Uncensored
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · ScottzillaSystems
Params177B
Context—
Smallest0.9 GB
GGUF
MI
Mistral 7B Instruct v0.2 llamafile
Mistral · mozilla-ai
Params7.24B
Context32K
Smallest14.5 GB
GGUF
GE
Gemma The Writer N Restless Quill 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
Roleplay
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen2.5 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B
Qwen · 6block
Params27B
Context256K
Q4_K_M17.7 GB
Vision
LL
Nidum Llama 3.2 3B Uncensored
Llama · lemuralabs
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingRoleplay
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Q4_K_M21.5 GB
Reasoning
QW
Qwen_Qwen3 VL 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
FU
Fun-CosyVoice3-0.5B-2512-voices
Fun · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
QW
Qwen 3 8b Heretic
Qwen · DreamFast
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
CodingVision
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
GGUF
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · dongfangshuo
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · HeYujie
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
SM
smoothMixWan22 I2V
Smoothmixwan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF

Keep browsing