GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 14B Instruct 1M
Qwen · lmstudio-community
Params14.8B
Context986K
Q4_K_M9.0 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
AP
Apex 35B V1.0
Apex · bartowski
Params35.5B
Context256K
Q4_K_M22.8 GB
SW
Swish 31B Final
Swish · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GE
Gemma 4 31B Monadize v0.1
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
QW
Raw Uncensored Qwen3 14b Heretic Recovered
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
MA
magnum v4 12b
Magnum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HY
Hy MT2 7B
mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored GGUF UltraOptimised DSpark MTP
Qwen · Solstice-AI
Params26.9B
Context256K
Q4_K_M1.1 GB
QW
Qwen3 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.8 GB
ST
Step 3.7 Flash
Step · stepfun-ai
Params197B
Context—
Smallest0.5 GB
QW
Qwen3VL 8B Uncensored HauhauCS Balanced
Qwen · HauhauCS
Params8.2B
Context256K
Q4_K_M5.0 GB
NE
Nex N2 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
QW
Qwen3.5 9B BOS Q8 NonThinking
Qwen · shaban2024
Params8.95B
Context256K
Smallest9.5 GB
TE
Ternary Bonsai 4B
Ternary · prism-ml
Params4B
Context32K
Smallest1.1 GB
OC
Occamy 1.0 APEX I MiniPlus V2.1
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8 27B Whitehat
Qwen · QuaduxIT
Params27.3B
Context256K
Q4_K_M16.8 GB
HE
0 hero Matter 0.2 7B
Hero · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 Cyber RedTeam Surgical Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
AR
Artoma Lexicon 31B
Artoma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
JE
JEV 35B
Jev · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
IN
InternVL3_5 2B
Internvl · bartowski
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen3 30B A3B
Qwen · 6block
Params30.5B
Context40K
Q4_K_M18.6 GB
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
AR
AREX Turbo
Arex · bartowski
Params4.2B
Context256K
Q4_K_M2.9 GB
MA
magnum v4 12b
Magnum · anthracite-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB