GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
IN
Index Translate 9B
Index · IndexTeam
Params9.2B
Context256K
Q4_K_M5.8 GB
SM
SmolLM2 135M Instruct
SmolLM · bartowski
Params135M
Context8K
Q4_K_M0.1 GB
QW
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated MTP
Qwythos · huihui-ai
Params9.2B
Context1024K
Smallest5.8 GB
VO
.VoiceTut-TTS-gguf-root
Voicetut · mohammedaly22
Params—
Context—
Smallest1.4 GB
WA
Wald-4B v1.2
Wald · org2ai
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Qwen3-32B
Qwen · unsloth
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.8 27B pi
Qwen · bytkim
Params27B
Context256K
Q4_K_M1.1 GB
QW
.QwenCleo-ASR-gguf-root
Qwen · mohammedaly22
Params—
Context—
Smallest2.5 GB
LL
Llama3.3 8B Instruct Thinking Heretic Uncensored Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5-2B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
KE
Kev 4B
Kev · ggml-org
Params4.2B
Context256K
Q4_K_M3.0 GB
QW
Qwen3.5 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
QW
Qwen3.8 27B ABLITERATED BF16
Qwen · Blackfrost-AI
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 9B Heretic Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params122B
Context256K
Q4_K_M76.5 GB
UN
Underdog Saluki 27B 1.0 MTP
Underdog · Kujira
Params27.3B
Context256K
Smallest8.3 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 L Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.5 GB
WA
Wan2.2 TI2V 5B Turbo
Wan · hum-ma
Params5B
Context—
Q4_K_M3.4 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · SC117
Params447M
Context256K
Smallest14.3 GB
IN
WanVideo comfy
Infinitetalk · Kijai
Params2.49B
Context—
Q4_K_M1.4 GB
TE
Ternary Bonsai 2 27B Uncensored Heretic v2
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
MI
models--mistralai--Mistral-7B-Instruct-v0.3
Mistral · MaziyarPanahi
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Instruct 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M18.0 GB
MI
models--v2ray--Mixtral-8x22B-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
QW
Qwen 3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Heretic GSQ RCO
Qwen · 0bserverx
Params27B
Context256K
Smallest8.4 GB
QW
Qwen_Qwen3.6 27B
Qwen · lmstudio-community
Params27B
Context256K
Q4_K_M16.5 GB