GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sakura 13B v0.11Pre
Sakura · Kunger
Params14.5B
Context4K
Smallest5.5 GB
GGUF
LL
llama2_koen_13b_SFTtrain
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
KO
Kyujinpy KoT Platypus2 13B
Kot · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
KO
Korean OpenOrca v3
Korean · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
NA
Nano_Q2
Nano · NLPark
Params1.78B
Context32K
Smallest1.3 GB
GGUF
CU
PracticeLLM Custom KoLLM 13B v6
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
QW
ROLEPL AI v2 Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
RoleplayTool use
SA
Sakura SOLAR Instruct DPO v2
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AN
ANKH3_large
Ankh · mradermacher
Params1.88B
Context512
Q4_K_M1.2 GB
GGUF
DE
Dear My best Friends v2 13B
Dear · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Llama 3.1 Sherkala 8B Chat
Llama · DiDustin
Params8.29B
Context8K
Smallest8.8 GB
GGUF
MI
mistral
Mistral · bineric
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DR
DRT O1 14B
Drt · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
AP
Nous V1 2B
Apollo · aayanmishra-ml
Params1.72B
Context40K
Smallest1.8 GB
ReasoningTool use
PE
PersianMind v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Smallest3.9 GB
GGUF
SA
Kyujinpy Sakura SOLAR Instruct DPO v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
QW
Jade_Qwen3_4B
Qwen · dougiefresh
Params4.02B
Context40K
Smallest4.3 GB
Coding
QW
Qwen3 4B Thinking 2507 GRPO Uncensored V2
Qwen · puwaer
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
PL
Ifuseok Yi Ko Playtus Instruct v0.2
Playtus · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
AISquare Instruct llama2 koen 13b v0.9.15
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
WE
weak KoRAE 13b
Weak · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
FR
Frankenstein MoE En 10.7Bx4
Frankenstein · RichardErkhov
Params36.1B
Context4K
Q4_K_M21.8 GB
GGUF
PL
Platypus2 13B
Platypus · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
RO
Rombos 2.5 T.E 8.1
Rombos · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
PlatYi 34B Llama Q v3
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
OR
original KoRAE 13b 3ep
Original · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
AI
Ailo152m events it
Ailo · xxrickyxx
Params152M
Context512
Q4_K_M0.1 GB
Coding
AN
andreagemelli/LFM2.5-350M-Extract-ML-LoRA
Andreagemelli · andreagemelli
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool use
LF
LFM2.5 350M IT Extract
Lfm · andreagemelli
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool use

Keep browsing