GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingTool useVision
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
GGUF
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hana 0.1 Fast
Qwen · dwmk
Params8.03B
Context32K
Smallest0.3 GB
Roleplay
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
alist food text qwen35
Qwen · NateRunsA-LIST
Params44M
Context256K
Q4_K_M1.3 GB
Vision
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
SP
Split Untied 31B
Split · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
DE
FuseO1 DeepSeekR1 Qwen2.5 Coder 32B Preview v0.1
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Coding
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · nightmedia
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
RU
MN 12B Runeweaver RP RU
Runeweaver · limloop
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
IN
Index Nailong 9B
Index · IndexTeam
Params8.95B
Context224K
Q4_K_M5.6 GB
GGUF
D3
d3-27B Artemis 12.3GB
turintech
Params26.9B
Context256K
Smallest12.3 GB
ReasoningTool use
MI
fpham_autolycus-mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
Vision
FL
Flux 3 Image Klein Prompt Upsampler Abliterated
Flux · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Occult Nail 1.0 35B A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
ReasoningVision
QW
Qwen3.8 27B Heretic Uncensored MTP
Qwen · Unb0rn
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
OL
Olmo-3-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3 VL 32B Instruct Ultra Uncensored Heretic
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3-4B-Nymphaea-RP
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Roleplay
VI
VieNeu TTS v2 Turbo
Vieneu · pnnbao-ump
Params112M
Context4K
Smallest0.2 GB
Coding
QW
Qwen3.6 35B A3B
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
Vision
SW
Swallow MS 7b Instruct v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
GE
Gemma4 Gutenberg 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision

Keep browsing