GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
RavenXAiLabs Chaos Agent Qwen3.8 27B Frontier Intelligence Injected OBLITERATED
Qwen · deadbydawn101
Params27B
Context256K
Q4_K_M16.5 GB
MI
Ministral 3 8B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
SE
T Search
Search · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Chinese Mixtral 8x7B
Mistral · RichardErkhov
Params46.9B
Context32K
Q4_K_M28.6 GB
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
QW
Qwen3.8 Flash Coder APEX I MiniPlus V2.1
Qwen · IsValorum
Params42.6B
Context256K
Smallest21.8 GB
VE
VeriLoop E2 GSQ RCO
Veriloop · tahaalam2009
Params27B
Context256K
Smallest8.5 GB
QW
Ornith 1.5 35B A3B Uncensored
Qwen · 0xKitkat
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Hermes-2-Pro-Mistral-7B-infinity
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Dark Scarlett v1.0 26B A4B
Dark · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
QwenDGAF V3 4B
Qwen · hecan3d
Params4B
Context40K
Q4_K_M2.5 GB
JA
Javi0.3 2B
Javi · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
KO
kokoro 82m
Kokoro · cstr
Params82M
Context—
Smallest0.1 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
Glistening Gem 31B v2.1
Glistening · kin2341
Params30.7B
Context256K
Q4_K_M19.6 GB
VL
VLX Seek 1.5 10B
Vlx · Asher-1
Params1.1B
Context—
Smallest0.0 GB
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM4.1 8B
MiniCPM · openbmb
Params8.2B
Context64K
Q4_K_M5.0 GB
IN
indextts 1.5
Indextts · cstr
Params134M
Context—
Smallest0.3 GB
QW
Qwen3.8-27B-DFlash2
Qwen · magnitudedev
Params1.92B
Context256K
Smallest2.1 GB
GR
Granite 3b Code Instruct 128k
Granite · RichardErkhov
Params3.48B
Context125K
Q4_K_M2.1 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3-Vl-32B-Instruct-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
QW
qwen3loop 0.6b sft deep supervision v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
CL
Clover 35B A3B Preview GGUF IQ4 XS Mac
Clover · austindixson
Params34.7B
Context128K
Smallest18.9 GB