GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2 Horizon 3.7B
Horizon · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Therapy 3.8
Qwen · Verdugie
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen3 VL 8B Instruct Abliterated v2
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
AL
AliceAI Foundation 80B A3B Base
Aliceai · Yamada114514
Params79.6B
Context256K
Q4_K_M48.4 GB
Coding
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled v2
Qwen · Jackrong
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
JE
JEV 27B VL
Jev · Atlas3D
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · perplexity-ai
Params27.3B
Context256K
Q4_K_M1.1 GB
Vision
MO
MOSS Image SFT
Moss · leejet
Params5.08B
Context—
Smallest2.2 GB
GGUF
FL
vllm-d3-flash
Flash · ggml-org
Params8.95B
Context256K
Q4_K_M6.6 GB
Vision
TE
Test Frankenstein
Test · ND911
Params11.9B
Context—
Smallest6.9 GB
GGUF
QW
Qwen3.8 9B Distill uncensored heretic Q4 K M
Qwen · ge525
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
GGUF
PA
PaddleOCR VL 1.5
Paddleocr · PaddlePaddle
Params467M
Context128K
Smallest0.9 GB
Vision
QW
Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Atomic Chat / Qwen3.5 9B
Qwen · AtomicChat
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3.8
Qwen · cHunter789
Params27B
Context256K
Smallest14.8 GB
Vision
JI
jina reranker v1 tiny en
Jina · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB
Vision
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
SP
Spark X2.6 4B
Spark · bartowski
Params4.11B
Context1024K
Q4_K_M2.6 GB
GGUF
QW
Qwen3.5-2B
Qwen · weareapexcreators
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 2B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningVision
GE
gemma 4 E4B it uncensored
Gemma · TrevorJS
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
MI
MiniCPM5 2B LocalAI
MiniCPM · weareapexcreators
Params2.52B
Context128K
Smallest2.7 GB
GGUF
AN
AnimeGen I2V
Animegen · NullpoLab
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
NA
Nanbeige4.2 3B
Nanbeige · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
GGUF

Keep browsing