GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Reasoning
VE
Veloxy Flash 15B i1
Veloxy · zveloxy
Params8.95B
Context512K
Q4_K_M5.6 GB
Reasoning
GE
Gemma 4 E4B It OBLITERATED v3.1
Gemma · Aimeeluvssya
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · DoorZekor
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
QW
Qwen3.8 27B OBLITERATED
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 9B Uncensored
Qwen · LEONW24
Params9.65B
Context256K
Q4_K_M6.7 GB
GGUF
ME
Mellum2.1 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.8 GB
Reasoning
MI
MiniCPM V 4.7 1B LocalAI
MiniCPM · weareapexcreators
Params1.01B
Context256K
Smallest1.1 GB
Vision
MI
mistralai_mixtral-8x7b-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
Vision
ME
G4 MeroMero v2 31B Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
QW
Qwen2.5 7B Instruct Abliterated
Qwen · richardyoung
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
QW
Qwen3.8 Flash Next Abliterated Uncensored
Qwen · cc1244578151
Params177B
Context256K
Smallest83.9 GB
CodingReasoningTool use
SA
Sage A1.5 F16
Sage · InternScience
Params35.5B
Context256K
Smallest71.1 GB
CodingTool useVision
QW
Qwopus3.5 9B Coder Templatefix Hf
Qwopus · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
LI
LightOnOCR 3 4B
Lightonocr · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.8-27B
Qwen · Greatjedi
Params27B
Context256K
Smallest11.2 GB
GGUF
QW
Qwen3 Omni 30B A3B Captioner
Qwen · presencesw
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
DE
decider 4b
Decider · Mapika
Params4.2B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
CodingVision
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
GGUF
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
QW
Qwen3.8 27B abliterated MTP
Qwen · hotdogs
Params27B
Context256K
Q4_K_M16.8 GB
Vision

Keep browsing