GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 4B Heretic
Qwen · darrellbest
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
MY
Mythos v2 9b
Mythos · fableforge-ai
Params9.2B
Context256K
Q4_K_M5.8 GB
Tool use
HO
Holo 3.1 4B
Holo · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
IN
Index Anisora V3.2
Index · youcef079
Params14.3B
Context—
Q4_K_M10.1 GB
GGUF
MI
devstral-small-2507
Mistral · mistralai
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
TO
tokyotech llm Swallow MS 7b instruct v0.1
Tokyotech · mmnga
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
MO
MOSS TTS Local Transformer v1.5
Moss · mudler
Params2.12B
Context—
Smallest0.0 GB
GGUF
QW
qwen image edit plus
Qwen · calcuis
Params14.3B
Context—
Q4_K_M11.7 GB
GGUF
QW
qwen2-7b-instruct
Qwen · Qwen
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma4 12B IT Abliterated
Gemma · DuoNeural
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
QW
Qwen 35B A3B SignOfFour Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.5 GB
CodingReasoningTool use
PR
Promethean Dawn 26B A4B
Promethean · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3.5 9B Cold Fusion GAIN v1.0 Uncensored Heretic NEO MAX Imatrix
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
Qwen3.5 0.8B GGUF uncensored opus distill
Qwen · amkkk
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · cs2764
Params34.7B
Context256K
Smallest28.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
QW
Qwen3.8-27B
Qwen · kingjones777
Params26.9B
Context256K
Smallest1.7 GB
Vision
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
Reasoning
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
GE
Gemma 4 E2B It Heretic Ara
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
NA
VisionPsy Nano 460M Flash GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
Vision
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
SA
Sabi Noema
Sabi · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Tool use
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
QW
JonathanColetti Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen2 Audio 7B Instruct
Qwen · mradermacher
Params7.75B
Context8K
Q4_K_M4.8 GB
Vision
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
GGUF

Keep browsing