GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
VE
Veloxy Flash 15B i1
Veloxy · zveloxy
Params8.95B
Context512K
Q4_K_M5.6 GB
GE
Gemma 4 E4B It OBLITERATED v3.1
Gemma · Aimeeluvssya
Params7.52B
Context128K
Q4_K_M5.3 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · DoorZekor
Params16.4B
Context—
Q4_K_M10.8 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 9B Uncensored
Qwen · LEONW24
Params9.65B
Context256K
Q4_K_M6.7 GB
ME
Mellum2.1 12B A2.5B Thinking
Mellum · bartowski
Params12.1B
Context128K
Q4_K_M8.8 GB
MI
MiniCPM V 4.7 1B LocalAI
MiniCPM · weareapexcreators
Params1.01B
Context256K
Smallest1.1 GB
MI
mistralai_mixtral-8x7b-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
ME
G4 MeroMero v2 31B Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 VL 7B NSFW Caption V3
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 7B Instruct Abliterated
Qwen · richardyoung
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Qwen3.8 Flash Next Abliterated Uncensored
Qwen · cc1244578151
Params177B
Context256K
Smallest83.9 GB
SA
Sage A1.5 F16
Sage · InternScience
Params35.5B
Context256K
Smallest71.1 GB
QW
Qwopus3.5 9B Coder Templatefix Hf
Qwopus · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
LI
LightOnOCR 3 4B
Lightonocr · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8-27B
Qwen · Greatjedi
Params27B
Context256K
Smallest11.2 GB
QW
Qwen3 Omni 30B A3B Captioner
Qwen · presencesw
Params30.5B
Context64K
Q4_K_M18.6 GB
DE
decider 4b
Decider · Mapika
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3.8 27B abliterated MTP
Qwen · hotdogs
Params27B
Context256K
Q4_K_M16.8 GB