GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
QW
Qwen3-TTS-12Hz-0.6B-Base
Qwen · Sachit-18
Params2.5B
Context—
Smallest1.4 GB
WE
Westest 7B
Westest · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SQ
defog sqlcoder 7b
Sqlcoder · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SH
sheared silicon10p
Sheared · Aryanne
Params2.7B
Context4K
Smallest1.3 GB
RO
Rocket 3B
Rocket · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
ST
Stablelm 3b 4e1t
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
BL
kromeurus/L3-Blackfall-Summanus-v0.1-15B
Blackfall · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
LL
Llama3 8B Traditional Chinese roleplay chat
Llama · Tarklanse
Params8.03B
Context8K
Q4_K_M4.9 GB
LY
lynn 7b alpha
Lynn · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
CI
CiSiMi
Cisimi · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
MA
IS-LM-3B
Maddes · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
OP
openbuddy-stablelm-3b-v13
Openbuddy · maddes8cht
Params2.81B
Context4K
Q4_K_M1.7 GB
NS
Mt5 Large
Nsina · mradermacher
Params1.23B
Context512
Q4_K_M0.8 GB
AK
Akins-3B
Akins · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
HU
HumanPet X1 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
MA
makellm-ja-char-200m-chat
Makellm · Sido
Params217M
Context512
Smallest0.2 GB
MA
makellm ja spm 200m 2x 8k
Makellm · Sido
Params238M
Context8K
Smallest0.1 GB
FL
Flora_7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kiqu 70b
Kiqu · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
HE
Kyutai.Helium 1 2b Wiki
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
EL
elitegpt i1
Elitegpt · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
JP
JPharmatron 7B
Jpharmatron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Luna AI Llama2 Uncensored
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
MA
Marx-3B-V3
Marx · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
RE
ResplendentAI Paradigm 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
lynn-A2.7B-rp-v1
Lynn · mradermacher
Params14.3B
Context32K
Q4_K_M9.5 GB
MI
Minirecord/Mini_DPO_test02
Mini · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB