GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Smallest16.0 GB
Vision
QW
Qwen25 Coder 3b Claude
Qwen · ryzdfm
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingReasoning
MT
Mtrini SVL 2.0
Mtrini · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
KA
Kat Coder v2.5 Dev
Kat · Myric
Params34.7B
Context256K
Smallest12.7 GB
Coding
QW
Rice Cracker Qwen3.5 0.8B Abliterated Base
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Coding
OV
OvisOCR2
Ovisocr · Abiray
Params752M
Context256K
Q4_K_M0.5 GB
Vision
GR
Granite 4.2 8b
Granite · bartowski
Params8.79B
Context128K
Q4_K_M5.5 GB
ReasoningTool use
NO
Nous Hermes 2 SOLAR 10.7B
Nous · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
SE
SenseNova U1 8B MoT Merger
Sensenova · smthem
Params17.6B
Context—
Smallest13.9 GB
GGUF
KO
Kolibri 1 Heretic
Kolibri · mradermacher
Params78B
Context256K
Q4_K_M47.5 GB
Reasoning
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CL
Clover 35B A3B Preview
Clover · na0x2c6
Params34.7B
Context128K
Q4_K_M21.8 GB
ReasoningTool use
AE
AesCode 32B
Aescode · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Coding
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3.8-27B
Qwen · Shishkipiski
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
QW
Qwen3 8B Q8 0 full v2
Qwen · RacerMiner
Params8.19B
Context40K
Smallest8.7 GB
GGUF
LA
speechbrain/lang-id-voxlingua107-ecapa
Lang · handy-computer
Params21M
Context—
Smallest0.0 GB
GGUF
GR
Ibm Granite_Granite 4.0 H Tiny
Granite · lmstudio-community
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
FL
FLUX.1 schnell
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
PH
Athene Phi 3.5 mini instruct orpo i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
NE
NeoHorse 1 9B Math SFT
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
QW
Qwen3.8-27B
Qwen · Bucoid
Params27.3B
Context256K
Smallest13.9 GB
GGUF
CL
Clef
Clef · abenzerps
Params27B
Context256K
Q4_K_M16.5 GB
Vision
AR
AREX 2 i1
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled Reap
Qwen · brunopio
Params14.1B
Context256K
Q4_K_M8.7 GB
Reasoning
QW
Qwen3.8-27B
Qwen · yachiyo8080
Params27.3B
Context256K
Q4_K_M16.6 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
qwen image
Qwen · calcuis
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
QW
Carnice Qwen3.6 MoE 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF

Keep browsing