GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
SQ
sqlcoder 70b alpha
Sqlcoder · tensorblock
Params69B
Context16K
Smallest25.5 GB
ZO
ZooZeroGPT 14B
Zoozerogpt · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
MI
mimodel
Mimodel · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
SQ
sqlcoder 7b 2 copy
Sqlcoder · bayanatawneh
Params6.74B
Context16K
Smallest4.8 GB
HO
Hourai2 Yomi 90m v1
Hourai · WariHima
Params92M
Context32K
Smallest0.2 GB
ME
Megakiqu 120b i1
Megakiqu · mradermacher
Params120B
Context32K
Smallest25.2 GB
ST
StableLM 3B 4E1T
Stablelm · rozek
Params2.8B
Context4K
Smallest1.4 GB
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Q4_K_M9.1 GB
ST
rocket-3B
Stablelm · newsletter
Params2.8B
Context4K
Smallest2.3 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
HO
Hourai2 Zenz 90m v1
Hourai · WariHima
Params92M
Context32K
Smallest0.2 GB
LL
llama 3 sqlcoder 8b
Llama · omeryentur
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
HO
Hourai3 7m Embedding Ja Gguf
Hourai · WariHima
Params7M
Context125K
Smallest0.0 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
MI
devhyun88 hyun mistral 7b orca platypus refine
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoshidereRP 8B
Roshidererp · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
gua a v0.1 ft mistral 7b
Mistral · thinkPy
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
M SOLAR 10.7B v1.2
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 3
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LY
lynn 7b alpha i1
Lynn · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Luna AI Llama2 Uncensored Q2 K
Llama · Ffftdtd5dtft
Params6.74B
Context2K
Smallest2.5 GB
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Q4_K_M9.1 GB
MO
Gn Model
Model · eric-hugging-cn
Params8.03B
Context128K
Smallest8.5 GB
EN
garim guard
Encoder · cycloevan
Params4.65B
Context128K
Q4_K_M3.4 GB
IN
Yi Ko 6B Instruct v1.5 DPO
Instruct · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
SU
subrit legal gpt2 quecto v1
Subrit · subrit
Params124M
Context1K
Smallest0.1 GB
QW
red virgin 7b
Qwen · lerugray
Params7.62B
Context32K
Smallest5.4 GB
SY
Synatra 7B v0.3 Translation Q4 K M
Synatra · andreass123
Params7.24B
Context32K
Q4_K_M4.4 GB