GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
makellm-ja-char-75m-chat
Makellm · Sido
Params82M
Context256
Smallest0.2 GB
GGUF
HO
hourai3 ja toxicity 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
GGUF
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest2.1 GB
GGUF
CB
cbt3model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 2 13b Chat Japanese Lora
Llama · nerukom
Params13B
Context—
Smallest0.0 GB
GGUF
HE
Helium 1 2b Science
Helium · NikolayKozloff
Params2.02B
Context4K
Smallest2.2 GB
GGUF
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
llama-3-sqlcoder-8b
Llama · upendrab
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest10.7 GB
GGUF
MI
Mini_Synatra_SFT
Mini · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
strela
Strela · NikolayKozloff
Params3.02B
Context4K
Smallest1.7 GB
GGUF
LL
Cydinfo Llama3 8b Lora v01
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
ME
Megakiqu 120b
Megakiqu · mradermacher
Params120B
Context32K
Smallest44.2 GB
GGUF
PH
sup sample 1 phi3 mini
Phi · gnelson
Params3.82B
Context4K
Smallest4.1 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · Fizzarolli
Params15B
Context8K
Smallest8.6 GB
GGUF
PW
Pwen 3.5 2B
Pwen · FreeAIn
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
PA
Paradigm 7B Q5 K M
Paradigm · EmanuelOverride
Params7.24B
Context32K
Smallest5.1 GB
GGUF
SQ
sqlcoder 8b gguf renbingzhang
Sqlcoder · renbingzhang
Params8.03B
Context8K
Smallest8.5 GB
Coding
MA
maiurilorenzo dante gpt
Maiurilorenzo · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Minirecord Mini DPO test02
Minirecord · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
SQ
Sqlcoder 7b 2 Q4 K M.gguff
Sqlcoder · ahmedtalal
Params6.74B
Context16K
Smallest3.3 GB
Coding
PA
Paradigm 7B Q4 K M
Paradigm · EmanuelOverride
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
QW
books model
Qwen · robertolofaro
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
DE
DeepDolphin 3x8B
Deepdolphin · mradermacher
Params19.3B
Context128K
Q4_K_M11.7 GB
Tool use
IN
indri 0.1 124m tts
Indri · 11mlabs
Params193M
Context1K
Smallest0.2 GB
GGUF
JP
JPharmatron 7B
Jpharmatron · EQUES
Params7.62B
Context32K
Smallest15.2 GB
Tool use
QW
aiethics model
Qwen · robertolofaro
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

Keep browsing