GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3 8B Abliterated
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
SM
SmolLM3 3B
SmolLM · ggml-org
Params3.08B
Context64K
Q4_K_M1.9 GB
QW
LFM2.5 8B A1B
Qwen · DavidAU
Params8.47B
Context125K
Smallest4.6 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GP
GPTOSS-120B-Uncensored-HauhauCS-Aggressive-MXFP4
gpt-oss · HauhauCS
Params117B
Context128K
Smallest65.4 GB
MX
mxbai embed xsmall v1
Mxbai · mixedbread-ai
Params24M
Context4K
Smallest0.0 GB
QW
Qwen3.8 27B Heretic Ara 16GB VRAM IQ4 XS MTP
Qwen · Bucoid
Params27B
Context256K
Smallest13.7 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 0.8B
Qwen · bartowski
Params773M
Context256K
Q4_K_M0.6 GB
ME
Hy Memory 30B A3B
Memory · tencent
Params30B
Context256K
Q4_K_M18.2 GB
QW
Qwen3.5 9B Ultra Uncensored Heretic
Qwen · llmfan46
Params8.95B
Context256K
Q4_K_M5.5 GB
BR
Breeze-ASR-25
Breeze · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
QW
Swift-1.5-Qwen3.8-27B-Uncensored-MTP
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Huihui gemma 4 31B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params30.7B
Context128K
Smallest1.0 GB
SA
Sage-A1.5
Sage · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · desirel
Params16.4B
Context—
Q4_K_M10.8 GB
MI
Voxtral Mini 3B
Mistral · handy-computer
Params4.7B
Context—
Q4_K_M3.0 GB
GE
gemma 4 26B A4B it qat heretic
Gemma · SC117
Params25.2B
Context256K
Smallest14.2 GB
SE
Hermes 4_3_36b
Seed · NousResearch
Params36.2B
Context512K
Q4_K_M21.8 GB
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
QwQ 32B
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
ME
G4 MeroMero 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
LT
LTX Video
Ltx · Isi99999
Params21B
Context—
Q4_K_M14.3 GB
GR
Grok 1
Grok · Arki05
Params316B
Context8K
Smallest65.3 GB
GE
gemma 4 12B it
Gemma · AtomicChat
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3 Coder Next Abliterated
Qwen · bartowski
Params79.7B
Context256K
Q4_K_M48.6 GB
BO
Bonsai-4B
Bonsai · prism-ml
Params4B
Context32K
Smallest0.6 GB