GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OX
OxCoder 9B GMCE
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
UM
umiyuki Japanese Chat Umievo itr001 7b
Umiyuki · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
ME
Melody1437 35B A3B
Melody · ReadyArt
Params35.5B
Context256K
Q4_K_M21.7 GB
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
EX
models--automerger--Experiment28Experiment29-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3.2 DeepHermes 3 3B Preview Reasoning MAX NEO Imatrix
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.5 GB
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
AL
Hy MT2 30B A3B
Alphazimuth · alphaZimuth
Params30B
Context256K
Smallest12.4 GB
LL
gguf lora llama3 midjourney prompt generator
Llama · rvian
Params8B
Context8K
Q4_K_M4.9 GB
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
CO
ConfigurableSOLAR 10.7B i1
Configurablesolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · Voodisss
Params7.57B
Context40K
Q4_K_M4.7 GB
RE
ReFeed 8B
Refeed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Notyourmom1
Params27B
Context256K
Q4_K_M18.0 GB
GR
Groot 19B A3B 261023
Groot · GrootTeam
Params19B
Context256K
Q4_K_M11.7 GB
GE
Gemma 3 4b it MAX HORROR Uncensored DBL X Imatrix
Gemma · DavidAU
Params4.26B
Context128K
Q4_K_M3.5 GB
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
GR
granite-8b-code-instruct
Granite · ibm-granite
Params8.05B
Context4K
Q4_K_M4.9 GB
SM
SmolLM2 360M
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
DA
MN Dark Horror The Cliffhanger 18.5B
Dark · DavidAU
Params18.5B
Context1000K
Q4_K_M11.2 GB
MI
llava v1.6 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB