GGUF models: cc license

119 GGUF models listed under the cc license on Hugging Face. Always read the license text before commercial use. Sizes run from 33M to 70.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Walmart the bag Yi 6B Infinity Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LL
dreamgen llama3 8b instruct align test1 kto
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CosMoEAlpacaLisa 4x1b
Cosmoealpacalisa · mradermacher
Params5.37B
Context2K
Q4_K_M3.3 GB
GGUF
SO
macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLAR 19.2B Instruct v1.0
Solar · mradermacher
Params18.6B
Context4K
Q4_K_M11.2 GB
GGUF
BG
IMPETUS Climate bge small
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
Embedding
LL
dreamgen llama3 8b instruct align test2 kto
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
dreamgen/llama3-8b-instruct-align-test1-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CosmoAlpacaLisa 0.2 1b
Cosmoalpacalisa · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
GA
GalaxyFarAway DialoGPT Yoda i1
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
AI
Aika 7B
Aika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
Link1 270M
Link · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
OM
OmniCorso 7B
Omnicorso · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
Diana 7B
Diana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
rwitz2/go-bruins-v2.1.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
Severus WestLake 2x7B v2
Severus · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DI
Diana 7B i1
Diana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
aloobun/bun_mistral_7b_v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
go bruins v2.1.1
Bruins · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CA
Cammell Twilight v0.2 12B i1
Cammell · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
dreamgen/llama3-8b-instruct-align-test2-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral-9B-Instruct
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
CA
Cammell Twilight v0.2 12B
Cammell · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
YI
Yi 6B Infinity Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
CA
CabraQwen7b
Cabraqwen · MaziyarPanahi
Params7.72B
Context32K
Smallest5.4 GB
GGUF
ZO
ZooZeroGPT V1
Zoozerogpt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
bun mistral 7b v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Dark Triad Adam Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Dark Triad Adam Llama3.2 3B v2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
CO
CosmoAlpacaLisa 1b
Cosmoalpacalisa · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF

Keep browsing