GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
BO
prism ml Bonsai 8B unpacked
Bonsai · bartowski
Params8.19B
Context64K
Q4_K_M5.2 GB
GGUF
LL
Llama 2 Coder 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
ME
Mero Artemis 31B v1
Mero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
LL
Reflection Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LY
LYNX ALPHA
Lynx · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
VN
Vnpen Writer 9b v1.0
Vnpen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 32B ArliAI RPMax v1.3
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
FL
flux.1dev abliterated
Flux · raidenzeke
Params11.9B
Context—
Smallest12.7 GB
GGUF
QW
Qwen3.6 27B OBLITERATED
Qwen · OBLITERATUS
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen2.5 14B
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored JoyFox Aggressive
Qwen · joyfox
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
GL
AutoGLM Phone 9B
GLM · Luckybalabala
Params9.4B
Context64K
Q4_K_M6.2 GB
Vision
BO
Bonsai 27b 1bit CRACK
Bonsai · dealignai
Params27B
Context256K
Smallest4.7 GB
ReasoningTool useVision
MA
Magnum 12b v2
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DA
DataPilot ArrowPro 7B KUJIRA
Datapilot · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
IM
Z Image Turbo
Image · vantagewithai
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
MI
mistralai_Ministral 3 14B Instruct 2512 BF16
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
ST
L3-8B-Stheno-v3.3-32K
Stheno · DavidAU
Params8B
Context32K
Q4_K_M4.9 GB
Roleplay
QW
Qwen3.8-27B
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
ReasoningVision
GR
Granite 4.0 H Tiny
Granite · bartowski
Params6.94B
Context1024K
Q4_K_M4.3 GB
GGUF
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PR
Privacy Filter
Privacy · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
GGUF
QW
Qwen3 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
GE
Gemma-4-E4B-It
Gemma · ente-ai
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
AS
AstaBrief_8B
Astabrief · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GGUF
MI
MiniCPM5 2B DSpark
MiniCPM · openbmb
Params324M
Context128K
Smallest0.7 GB
CodingTool use

Keep browsing