GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
MA
makellm-ja-char-75m-chat
Makellm · Sido
Params82M
Context256
Smallest0.2 GB
HO
hourai3 ja toxicity 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest2.1 GB
CB
cbt3model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 2 13b Chat Japanese Lora
Llama · nerukom
Params13B
Context—
Smallest0.0 GB
HE
Helium 1 2b Science
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
llama-3-sqlcoder-8b
Llama · upendrab
Params8.03B
Context8K
Q4_K_M4.9 GB
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest10.7 GB
MI
Mini_Synatra_SFT
Mini · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest1.7 GB
LL
Cydinfo Llama3 8b Lora v01
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
ME
Megakiqu 120b
Megakiqu · mradermacher
Params120B
Context32K
Smallest44.2 GB
PH
sup sample 1 phi3 mini
Phi · gnelson
Params3.82B
Context4K
Smallest4.1 GB
AE
L3-Aethora-15B-V2
Aethora · Fizzarolli
Params15B
Context8K
Smallest8.6 GB
PW
Pwen 3.5 2B
Pwen · FreeAIn
Params1.88B
Context256K
Q4_K_M1.3 GB
PA
Paradigm 7B Q5 K M
Paradigm · EmanuelOverride
Params7.24B
Context32K
Smallest5.1 GB
SQ
sqlcoder 8b gguf renbingzhang
Sqlcoder · renbingzhang
Params8.03B
Context8K
Smallest8.5 GB
MA
maiurilorenzo dante gpt
Maiurilorenzo · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
MI
Minirecord Mini DPO test02
Minirecord · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
SQ
Sqlcoder 7b 2 Q4 K M.gguff
Sqlcoder · ahmedtalal
Params6.74B
Context16K
Smallest3.3 GB
PA
Paradigm 7B Q4 K M
Paradigm · EmanuelOverride
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
QW
books model
Qwen · robertolofaro
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
DeepDolphin 3x8B
Deepdolphin · mradermacher
Params19.3B
Context128K
Q4_K_M11.7 GB
IN
indri 0.1 124m tts
Indri · 11mlabs
Params193M
Context1K
Smallest0.2 GB
JP
JPharmatron 7B
Jpharmatron · EQUES
Params7.62B
Context32K
Smallest15.2 GB
QW
aiethics model
Qwen · robertolofaro
Params4.21B
Context256K
Q4_K_M2.7 GB