GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
pub llama 13b v1
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
CU
Custom KoLLM 13B v1 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
DR
DRT O1 7B
Drt · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
llama-2-koen-13b
Llama · yews1234
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
SA
Sakura 13B Korean v0.9
Sakura · SakuraLLM
Params14.2B
Context8K
Smallest12.3 GB
GGUF
TE
T.E 8.1 Q4 K M
Cran-May
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CU
Custom KoLLM 13B v6
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama-3-Spellbound-Instruct-8B-0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLARC MOE 10.7Bx4
Solarc · crystalkalem
Params36.1B
Context4K
Smallest15.7 GB
GGUF
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · RichardErkhov
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
SO
tlphams/solar-10.7b-merged-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PE
PersianMind-v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · hf-100
Params8.03B
Context8K
Smallest8.5 GB
GGUF
KO
KoRAE 13b
Korae · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
PR
Fish Speech S2 Pro Dual AR
Pro · tommyho510
Params4.95B
Context32K
Smallest9.9 GB
GGUF
AN
Ankh3 Xl
Ankh · introvoyz041
Params5.73B
Context512
Smallest3.2 GB
Embedding
LL
Kyujinpy PlatYi 34B Llama Q v2
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
CH
ChaoticNeutrals Lunar 10.7B
Chaoticneutrals · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
CarbonVillain 10.7B v3
Carbonvillain · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
CU
Custom KoLLM 13B v8 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
SO
kyujinpy/SOLAR-Platypus-10.7B-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
Jyoung105 KoR Orca Platypus 13B Neft
Kor · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
QW
qanimator rig 7b
Qwen · vigneshk0702
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
PH
Phi 3 Medium 128k Instruct
Phi · mirelurker
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
OO
OOM 13B 01
Oom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
Microllama_Char_500k_step
Microllama · RichardErkhov
Params85M
Context2K
Q4_K_M0.1 GB
GGUF
CZ
czech semantic embeddings
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
Embedding
AI
Ailo340m v4
Ailo · xxrickyxx
Params341M
Context1K
Smallest0.7 GB
Coding
CU
Custom KoLLM 13B v6 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing