GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · KilltheSniper
Params177B
Context—
Smallest0.9 GB
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
IN
Intern Decision 4B
InternLM · bombdefuser-124
Params4.21B
Context256K
Smallest4.5 GB
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Scion 35B A3B
Qwen · SkyIsNotGreen
Params34.9B
Context256K
Smallest0.1 GB
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
GR
Granite Vision 4.1 4b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
CA
Carbon-X
Carbon · HuggingFaceBio
Params14.8B
Context40K
Q4_K_M9.6 GB
MO
Moss image nsfw uncensored lora
Moss · axiomofmind
Params37M
Context—
Smallest0.1 GB
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO DFlash
Qwen · hotocooo
Params1.34B
Context256K
Q4_K_M0.8 GB
CO
Yi Coder 9B Chat
Coder · RichardErkhov
Params8.83B
Context128K
Q4_K_M5.3 GB
QW
Qwen3-TTS-12Hz-1.7B-CustomVoice
Qwen · sakasegawa
Params2.03B
Context—
Smallest1.3 GB
HO
Holo 3.1 9B
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
TW
Twilight Embrace 31B
Twilight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MO
Moss Image SFT
Moss · axiomofmind
Params5.08B
Context—
Smallest3.5 GB
WH
Whisper Tiny
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
MI
teknium_openhermes-2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PP
pplx decider flash gguf v1.2
Pplx · perplexity-ai
Params4.84B
Context256K
Smallest5.2 GB
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
QW
Qwen3.5 35B A3B Uncensored FernflowerAI APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
SP
Spark X2.5 4B Abliterated
Spark · SC117
Params4.11B
Context1024K
Smallest2.4 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.8-27B
Qwen · kaitchup
Params27.3B
Context256K
Smallest18.9 GB
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus3.5 4B Coder MTP HF
Qwen · Jackrong
Params334M
Context256K
Q4_K_M2.8 GB