GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B Abliterated
Qwen · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
SM
SmolLM3 3B
SmolLM · ggml-org
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
QW
LFM2.5 8B A1B
Qwen · DavidAU
Params8.47B
Context125K
Smallest4.6 GB
Reasoning
MI
Dolphin Mistral 24B Venice Edition
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GP
GPTOSS-120B-Uncensored-HauhauCS-Aggressive-MXFP4
gpt-oss · HauhauCS
Params117B
Context128K
Smallest65.4 GB
GGUF
MX
mxbai embed xsmall v1
Mxbai · mixedbread-ai
Params24M
Context4K
Smallest0.0 GB
Embedding
QW
Qwen3.8 27B Heretic Ara 16GB VRAM IQ4 XS MTP
Qwen · Bucoid
Params27B
Context256K
Smallest13.7 GB
GGUF
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.5 0.8B
Qwen · bartowski
Params773M
Context256K
Q4_K_M0.6 GB
Vision
ME
Hy Memory 30B A3B
Memory · tencent
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
QW
Qwen3.5 9B Ultra Uncensored Heretic
Qwen · llmfan46
Params8.95B
Context256K
Q4_K_M5.5 GB
Vision
BR
Breeze-ASR-25
Breeze · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
QW
Swift-1.5-Qwen3.8-27B-Uncensored-MTP
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
ReasoningVision
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Coding
GE
Huihui gemma 4 31B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params30.7B
Context128K
Smallest1.0 GB
Vision
SA
Sage-A1.5
Sage · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
WA
WAN2.2 14B Rapid AllInOne GGUF NSFW v10
Wan · desirel
Params16.4B
Context—
Q4_K_M10.8 GB
GGUF
MI
Voxtral Mini 3B
Mistral · handy-computer
Params4.7B
Context—
Q4_K_M3.0 GB
GGUF
GE
gemma 4 26B A4B it qat heretic
Gemma · SC117
Params25.2B
Context256K
Smallest14.2 GB
CodingVision
SE
Hermes 4_3_36b
Seed · NousResearch
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
WA
Wan2.1 FLF2V 14B 720P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
QW
Qwen Image
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
QW
QwQ 32B
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
ME
G4 MeroMero 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LT
LTX Video
Ltx · Isi99999
Params21B
Context—
Q4_K_M14.3 GB
GGUF
GR
Grok 1
Grok · Arki05
Params316B
Context8K
Smallest65.3 GB
GGUF
GE
gemma 4 12B it
Gemma · AtomicChat
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
QW
Huihui Qwen3 30B A3B Instruct 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen3 Coder Next Abliterated
Qwen · bartowski
Params79.7B
Context256K
Q4_K_M48.6 GB
Coding
BO
Bonsai-4B
Bonsai · prism-ml
Params4B
Context32K
Smallest0.6 GB
GGUF

Keep browsing