GGUF models: cc license
119 GGUF models listed under the cc license on Hugging Face. Always read the license text before commercial use. Sizes run from 33M to 70.6B parameters. The longest trained context is 1000K tokens.
YI
Walmart the bag Yi 6B Infinity Chat
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
dreamgen llama3 8b instruct align test1 kto
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
CosMoEAlpacaLisa 4x1b
Cosmoealpacalisa · mradermacher
Params5.37B
Context2K
Q4_K_M3.3 GB
SO
macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SO
SOLAR 19.2B Instruct v1.0
Solar · mradermacher
Params18.6B
Context4K
Q4_K_M11.2 GB
BG
IMPETUS Climate bge small
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
LL
dreamgen llama3 8b instruct align test2 kto
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dreamgen/llama3-8b-instruct-align-test1-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
CosmoAlpacaLisa 0.2 1b
Cosmoalpacalisa · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB
GA
GalaxyFarAway DialoGPT Yoda i1
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
AI
Aika 7B
Aika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
Link1 270M
Link · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
OM
OmniCorso 7B
Omnicorso · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Diana 7B
Diana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
rwitz2/go-bruins-v2.1.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Severus WestLake 2x7B v2
Severus · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
DI
Diana 7B i1
Diana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
aloobun/bun_mistral_7b_v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
go bruins v2.1.1
Bruins · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CA
Cammell Twilight v0.2 12B i1
Cammell · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
dreamgen/llama3-8b-instruct-align-test2-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral-9B-Instruct
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
CA
Cammell Twilight v0.2 12B
Cammell · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
YI
Yi 6B Infinity Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
CA
CabraQwen7b
Cabraqwen · MaziyarPanahi
Params7.72B
Context32K
Smallest5.4 GB
ZO
ZooZeroGPT V1
Zoozerogpt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
bun mistral 7b v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Dark Triad Adam Llama3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Dark Triad Adam Llama3.2 3B v2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CO
CosmoAlpacaLisa 1b
Cosmoalpacalisa · mradermacher
Params1.74B
Context2K
Q4_K_M1.1 GB