GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
OX
OxCoder 9B GMCE
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
UM
umiyuki Japanese Chat Umievo itr001 7b
Umiyuki · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
ME
Melody1437 35B A3B
Melody · ReadyArt
Params35.5B
Context256K
Q4_K_M21.7 GB
Roleplay
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
GGUF
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
GGUF
EX
models--automerger--Experiment28Experiment29-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3.2 DeepHermes 3 3B Preview Reasoning MAX NEO Imatrix
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
Vision
AL
Hy MT2 30B A3B
Alphazimuth · alphaZimuth
Params30B
Context256K
Smallest12.4 GB
GGUF
LL
gguf lora llama3 midjourney prompt generator
Llama · rvian
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
CO
ConfigurableSOLAR 10.7B i1
Configurablesolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · Voodisss
Params7.57B
Context40K
Q4_K_M4.7 GB
Embedding
RE
ReFeed 8B
Refeed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Notyourmom1
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
GR
Groot 19B A3B 261023
Groot · GrootTeam
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool useVision
GE
Gemma 3 4b it MAX HORROR Uncensored DBL X Imatrix
Gemma · DavidAU
Params4.26B
Context128K
Q4_K_M3.5 GB
Roleplay
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
Coding
GR
granite-8b-code-instruct
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
SM
SmolLM2 360M
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
DA
MN Dark Horror The Cliffhanger 18.5B
Dark · DavidAU
Params18.5B
Context1000K
Q4_K_M11.2 GB
Roleplay
MI
llava v1.6 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Vision
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
Vision

Keep browsing