GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · llmfan46
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
Tool use
QW
WhereOPD Qwen3.5 4B
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · DavidAU
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
DE
DeepNarra-Paham-Experimental
Deepnarra · DeepNarra
Params952M
Context2K
Smallest0.3 GB
GGUF
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.6 27B abliterated
Qwen · wangzhang
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MI
MiniCPM5-2B-Claude-Fable5-1-Thinking
MiniCPM · GnLOLot
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3 4B
Qwen · enacimie
Params4.02B
Context40K
Q4_K_M5.0 GB
GGUF
HO
Sakura K2 Horizon 7B
Horizon · webmp3
Params9B
Context512K
Smallest3.8 GB
GGUF
MI
MixTaoTruthful-13B-slerp
Mixtaotruthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DE
Qwen2.5 MOE 2X1.5B DeepSeek Uncensored Censored 4B
DeepSeek · DavidAU
Params4.1B
Context128K
Q4_K_M2.5 GB
Reasoning
QW
dnotitia_Smoothie Qwen3 4B
Qwen · Alcoft
Params4B
Context40K
Q4_K_M2.4 GB
Reasoning
QW
DPO Trained Qwen2.5 Python Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
MO
nightmare moss image
Moss · AbrahamPJ
Params5.08B
Context—
Smallest3.2 GB
GGUF
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
RoleplayVision
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DA
Dark Scarlett 27B v2.0
Dark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
CO
Yi Coder 1.5B
Coder · lmstudio-community
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Sakura MiniCPM V 4.7 1B Uncensored
MiniCPM · webmp3
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool use
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 1.7B
Qwen · rippertnt
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF

Keep browsing