GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 1.7B Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
DA
G4 Dark Soul 26B A4B
Dark · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
RoleplayVision
BO
Boundary 4x7b MoE i1
Boundary · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
RW
rwkv7 g1h 1.5b i1
Rwkv · RemySkye
Params1.53B
Context1024K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5 9B Harmonic
Qwen · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
QW
Qwen3.5 35B A3B
Qwen · Advantech-EIOT
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
HO
K2 Horizon 3.7B Heretic
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
QW
Qwen3.8 27B GSQ RCO IQ3 S recovered
Qwen · Joakimpalm-Zen
Params26.9B
Context256K
Smallest3.2 GB
ReasoningTool use
HO
K2 Horizon 7B Candor Uncensored
Horizon · candor-lab
Params9B
Context512K
Q4_K_M5.6 GB
ReasoningTool use
PA
Pantheon Proto RP 1.8 30B A3B
Pantheon · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
Roleplay
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
CO
confucius4 tts
Confucius · cstr
Params112M
Context—
Smallest0.1 GB
GGUF
GE
Gemma 4 26B A4B It SOMPOA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwythos 9B v2
Qwythos · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
Reasoning
QW
Dongfangshuo Qwen3.8 27B NSFW
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GR
Granite Guardian 4.1 8b
Granite · ibm-granite
Params8.38B
Context128K
Q4_K_M5.1 GB
ReasoningTool use
QW
PopiT Qwen3 4B Medical SFT 1128
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
NE
NeoHorse 1 9 Uncensored
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DA
Dark Scarlett 27B v3.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M23.5 GB
Roleplay
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen Qwen3.6 35B A3B
Qwen · batiai
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
GE
Gemma 4 12B It Heretic_Decensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GL
Huihui GLM 4.6V Flash abliterated
GLM · AliBilge
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
GE
gemma 4 E2B it UD japanese imatrix
Gemma · dahara1
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
MI
MiniCPM V 4.7 1B Heretic
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
RoleplayVision
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
ReasoningVision

Keep browsing