GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
MI
dolphin 2.8 mistral 7b v02
Mistral · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
AP
Apex 35B V1.0
Apex · bartowski
Params35.5B
Context256K
Q4_K_M22.8 GB
ReasoningTool useVision
SW
Swish 31B Final
Swish · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 4 31B Monadize v0.1
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Coding
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HY
Hy MT2 7B
mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
ST
Step 3.7 Flash
Step · stepfun-ai
Params197B
Context—
Smallest0.5 GB
GGUF
QW
Qwen3VL 8B Uncensored HauhauCS Balanced
Qwen · HauhauCS
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision
NE
Nex N2 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
QW
Qwen3.5 9B BOS Q8 NonThinking
Qwen · shaban2024
Params8.95B
Context256K
Smallest9.5 GB
ReasoningTool use
TE
Ternary Bonsai 4B
Ternary · prism-ml
Params4B
Context32K
Smallest1.1 GB
GGUF
OC
Occamy 1.0 APEX I MiniPlus V2.1
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 Cyber RedTeam Surgical Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
AR
Artoma Lexicon 31B
Artoma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
JE
JEV 35B
Jev · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
IN
InternVL3_5 2B
Internvl · bartowski
Params2.03B
Context40K
Q4_K_M1.3 GB
Vision
QW
Qwen3 30B A3B
Qwen · 6block
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
AR
AREX Turbo
Arex · bartowski
Params4.2B
Context256K
Q4_K_M2.9 GB
ReasoningTool useVision
MA
magnum v4 12b
Magnum · anthracite-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use

Keep browsing