GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · noctrex
Params4B
Context256K
Q4_K_M2.5 GB
Vision
MI
Ministral 3 14B Instruct 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
TE
Ternary Bonsai 2 27B Abliterated v2 PQ2 0 MTP
Ternary · BoldingBuilds
Params26.9B
Context256K
Smallest7.2 GB
ReasoningTool use
GE
Gemma 4 12B It
Gemma · bartowski
Params11.9B
Context128K
Q4_K_M7.7 GB
Vision
HE
Hemmingway 1
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GGUF
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated
Qwen · huihui-ai
Params7M
Context—
Smallest0.0 GB
GGUF
DI
diffusiongemma 26B A4B it
Diffusiongemma · unsloth
Params25.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
LFM2.5 2.6B
Qwen · DavidAU
Params2.7B
Context128K
Smallest1.5 GB
Reasoning
SE
Sentence Bert Swedish Cased
Sentence · KBLab
Params124M
Context512
Smallest0.3 GB
Embedding
SM
SmolVLM 500M Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
Vision
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 Coder Next
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Coding
QW
Qwen3 32B Abliterated
Qwen · RoadToNowhere
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen_Qwen3 VL 4B Instruct
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
Vision
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · groxaxo
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 14B Uncensored Instruct
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama 3.2 8X3B MOE Dark Champion Instruct uncensored abliterated 18.4B
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
Roleplay
MA
madlad400 3b mt
Madlad · google
Params2.94B
Context—
Smallest1.0 GB
GGUF
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.8-27B-RANA-abliterated
Qwen · abliterant
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8 9B heretic uncensored NVFP4
Qwen · Noobito45
Params8.95B
Context256K
Q4_K_M5.2 GB
ReasoningVision
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Ternary Bonsai 2 27B PTQ1 0 MTP
Qwen · sudoingx
Params27.3B
Context256K
Smallest6.3 GB
GGUF
MI
MiniCPM V 4.7 35B A3B CRACKv5 2p0
MiniCPM · dealignai
Params34.7B
Context256K
Q4_K_M22.6 GB
Vision
QW
Qwen3 8B
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW v2
Qwen · dongfangshuo
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use

Keep browsing