GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-TTS-12Hz-0.6B-Base
Qwen · Sachit-18
Params2.5B
Context—
Smallest1.4 GB
GGUF
WE
Westest 7B
Westest · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SQ
defog sqlcoder 7b
Sqlcoder · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
SH
sheared silicon10p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.3 GB
GGUF
RO
Rocket 3B
Rocket · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ST
Stablelm 3b 4e1t
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
BL
kromeurus/L3-Blackfall-Summanus-v0.1-15B
Blackfall · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
Llama3 8B Traditional Chinese roleplay chat
Llama · Tarklanse
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
LY
lynn 7b alpha
Lynn · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CI
CiSiMi
Cisimi · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
MA
IS-LM-3B
Maddes · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
GGUF
NS
Mt5 Large
Nsina · mradermacher
Params1.23B
Context512
Q4_K_M0.8 GB
GGUF
AK
Akins-3B
Akins · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
HU
HumanPet X1 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MA
makellm-ja-char-200m-chat
Makellm · Sido
Params217M
Context512
Smallest0.2 GB
GGUF
MA
makellm ja spm 200m 2x 8k
Makellm · Sido
Params238M
Context8K
Smallest0.1 GB
GGUF
FL
Flora_7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kiqu 70b
Kiqu · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
HE
Kyutai.Helium 1 2b Wiki
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
EL
elitegpt i1
Elitegpt · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
JP
JPharmatron 7B
Jpharmatron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Luna AI Llama2 Uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MA
Marx-3B-V3
Marx · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RE
ResplendentAI Paradigm 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
lynn-A2.7B-rp-v1
Lynn · mradermacher
Params14.3B
Context32K
Q4_K_M9.5 GB
Roleplay
MI
Minirecord/Mini_DPO_test02
Mini · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing