GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
NorLlama 3B
Norllama · MarsupialAI
Params3.07B
Context2K
Smallest2.3 GB
GGUF
KO
PracticeLLM KoSOLAR Platypus 10.7B
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
SO
SOLARC MOE 10.7Bx6
Solarc · tensorblock
Params53B
Context4K
Smallest19.3 GB
GGUF
LL
Llama 3.1 8B BookAdventures
Llama · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CU
Custom KoLLM 13B v3 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
RE
ReMM v2 L2 13B VARIANT
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
SA
Sakura SOLAR
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TO
Tower Plus 9B Abliterated Hf Data
Tower · Ryex
Params9.24B
Context8K
Smallest9.8 GB
GGUF
KO
Korean OpenOrca 13B
Korean · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
LL
PlatYi 34B Llama Q v3
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SE
SecuCoder
Secucoder · ivitopow
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
OR
original KoRAE 13b
Original · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
MiraTTS
Miratts · eugenehp
Params507M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Llama OuteTTS 1.0 1B
Llama · PiterOfc
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
ON
OneKE Q3 K L
Oneke · ADChahaha
Params13.3B
Context4K
Smallest7.1 GB
GGUF
MK
MKLLM-7B-Translate
Mkllm · NikolayKozloff
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
PL
PlatYi 34B LoRA
Platyi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BI
BiMediX Eng Q4 0
Bimedix · fernandoruiz
Params46.7B
Context32K
Smallest26.4 GB
GGUF
AN
Ankh3 Large
Ankh · introvoyz041
Params1.88B
Context512
Smallest1.1 GB
Embedding
SO
Beomi SOLAR KOEN 10.8B
Solar · tensorblock
Params10.8B
Context4K
Smallest4.1 GB
GGUF
BA
T5 Base Summarization Claim Extractor
Base · americansquid
Params223M
Context512
Q4_K_M0.1 GB
GGUF
TR
Triplex Q6 K
Triplex · nvhf
Params3.82B
Context128K
Smallest3.1 GB
GGUF
LL
Llama 3 KoEn 8B Instruct preview Q4 K M
Llama · e-lumos
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
freem_x_qwen
Qwen · rayondemiel
Params7.62B
Context128K
Smallest8.1 GB
GGUF
PL
PlatYi 34B 200K Q
Platyi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BB
bb335m Q4 K M
bh4
Params335M
Context4K
Q4_K_M0.3 GB
GGUF
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · Cran-May
Params14.8B
Context128K
Smallest6.7 GB
GGUF
LL
Chang Su Llama 2 13b Chat Ko
Llama · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
GGUF
KY
Kyujinpy PlatYi 34B 200K Q
Kyujinpy · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF

Keep browsing