GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · KilltheSniper
Params177B
Context—
Smallest0.9 GB
GGUF
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
IN
Intern Decision 4B
InternLM · bombdefuser-124
Params4.21B
Context256K
Smallest4.5 GB
Vision
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Scion 35B A3B
Qwen · SkyIsNotGreen
Params34.9B
Context256K
Smallest0.1 GB
GGUF
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · bartowski
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
GR
Granite Vision 4.1 4b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
Vision
CA
Carbon-X
Carbon · HuggingFaceBio
Params14.8B
Context40K
Q4_K_M9.6 GB
ReasoningTool use
MO
Moss image nsfw uncensored lora
Moss · axiomofmind
Params37M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO DFlash
Qwen · hotocooo
Params1.34B
Context256K
Q4_K_M0.8 GB
Reasoning
CO
Yi Coder 9B Chat
Coder · RichardErkhov
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
QW
Qwen3-TTS-12Hz-1.7B-CustomVoice
Qwen · sakasegawa
Params2.03B
Context—
Smallest1.3 GB
GGUF
HO
Holo 3.1 9B
Holo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TW
Twilight Embrace 31B
Twilight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
MO
Moss Image SFT
Moss · axiomofmind
Params5.08B
Context—
Smallest3.5 GB
GGUF
WH
Whisper Tiny
Whisper · handy-computer
Params38M
Context—
Q4_K_M0.0 GB
GGUF
MI
teknium_openhermes-2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
PP
pplx decider flash gguf v1.2
Pplx · perplexity-ai
Params4.84B
Context256K
Smallest5.2 GB
Vision
QW
Qwen3.8 14B Instruct Turbo
Qwen · mradermacher
Params14.7B
Context256K
Q4_K_M9.2 GB
ReasoningTool use
QW
Qwen3.5 35B A3B Uncensored FernflowerAI APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
GGUF
SP
Spark X2.5 4B Abliterated
Spark · SC117
Params4.11B
Context1024K
Smallest2.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
QW
Qwen3.5 9B Claude 4.6 HighIQ THINKING HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
QW
Qwen3.8-27B
Qwen · kaitchup
Params27.3B
Context256K
Smallest18.9 GB
ReasoningTool use
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
QW
Qwopus3.5 4B Coder MTP HF
Qwen · Jackrong
Params334M
Context256K
Q4_K_M2.8 GB
CodingReasoningTool use

Keep browsing