GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Satyr V0.1 4B
Qwen · PantheonUnbound
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
LL
Llm Jp 4.1 33b Thinking
Llm · llm-jp
Params33.2B
Context64K
Q4_K_M20.4 GB
Reasoning
QU
Quyet 1.0 Medium
Quyet · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
AC
ace
Ace · calcuis
Params3.31B
Context—
Q4_K_M0.1 GB
GGUF
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Dolphin3.0 Qwen2.5 1.5B
Qwen · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen3-Vl-235B-A22B-Instruct
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
Vision
QW
Qwen3-Vl-4B-Thinking
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3.8 27B Uncensored FP8
Qwen · theresa00l
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
QW
Qwen3.8 4B Distilled
Qwen · Ma7ee7
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
OL
olmOCR 2 7B 1025
OLMo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
SA
Sabi Noema
Sabi · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
JE
Jev-Style-0.8B-Decision-v3
Jev · chaoliangUNSW
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
RuadaptQwen3 4B Instruct
Qwen · RefalMachine
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
LE
lev
Lev · ggml-org
Params4.2B
Context256K
Q4_K_M3.0 GB
GGUF
QW
Qwen3.5 9B Uncensored
Qwen · bowmanslayer
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
QW
Qwopus3.6 27B v1 preview
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
Qwen3.6 35B A3B abliterated v2
Qwen · LMLiutenant
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.5 2B Uncensored Abliterix SOM
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
RoleplayVision
WA
Wan2.2 Fun 5B Control
Wan · QuantStack
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.6 35B A3B APEX MTP Strata Q5EXPS
Qwen · misthemAI
Params35.5B
Context256K
Smallest22.5 GB
GGUF
MI
nousresearch_nous-hermes-2-mixtral-8x7b-dpo
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
Coding
QW
Qwen AgentWorld 35B A3B MTP Uncensored APEX
Qwen · SC117
Params447M
Context—
Smallest0.2 GB
GGUF
MI
MiniCPM5 2B Abliterated Uncensored
MiniCPM · mondk
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
QW
Qwen3.8 2B Uncensored
Qwen · atakhadivi
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
OC
Occamy 1.0 APEX I MiniPlus V2.1 Abliterated
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3.8 27B Coder390 EfficientThink abliterated ROCmFPX
Qwen · ArtomYuan
Params27.3B
Context256K
Smallest14.6 GB
CodingVision

Keep browsing