GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LL
pub llama 13b v1
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
CU
Custom KoLLM 13B v1 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
DR
DRT O1 7B
Drt · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
llama-2-koen-13b
Llama · yews1234
Params13.2B
Context4K
Q4_K_M8.0 GB
SA
Sakura 13B Korean v0.9
Sakura · SakuraLLM
Params14.2B
Context8K
Smallest12.3 GB
TE
T.E 8.1 Q4 K M
Cran-May
Params7.62B
Context32K
Q4_K_M4.7 GB
CU
Custom KoLLM 13B v6
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Llama-3-Spellbound-Instruct-8B-0.2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
SOLARC MOE 10.7Bx4
Solarc · crystalkalem
Params36.1B
Context4K
Smallest15.7 GB
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · RichardErkhov
Params53B
Context4K
Q4_K_M32.1 GB
SO
tlphams/solar-10.7b-merged-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PE
PersianMind-v1.0
Persianmind · ysn-rfd
Params6.82B
Context2K
Q4_K_M4.1 GB
LL
Llama 3 Spellbound Instruct 8B 0.3
Llama · hf-100
Params8.03B
Context8K
Smallest8.5 GB
KO
KoRAE 13b
Korae · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
PR
Fish Speech S2 Pro Dual AR
Pro · tommyho510
Params4.95B
Context32K
Smallest9.9 GB
AN
Ankh3 Xl
Ankh · introvoyz041
Params5.73B
Context512
Smallest3.2 GB
LL
Kyujinpy PlatYi 34B Llama Q v2
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
CH
ChaoticNeutrals Lunar 10.7B
Chaoticneutrals · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
CarbonVillain 10.7B v3
Carbonvillain · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
CU
Custom KoLLM 13B v8 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
SO
kyujinpy/SOLAR-Platypus-10.7B-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
KO
Jyoung105 KoR Orca Platypus 13B Neft
Kor · tensorblock
Params13B
Context2K
Smallest4.9 GB
QW
qanimator rig 7b
Qwen · vigneshk0702
Params7.62B
Context32K
Q4_K_M4.7 GB
PH
Phi 3 Medium 128k Instruct
Phi · mirelurker
Params14B
Context128K
Q4_K_M8.6 GB
OO
OOM 13B 01
Oom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
MI
Microllama_Char_500k_step
Microllama · RichardErkhov
Params85M
Context2K
Q4_K_M0.1 GB
CZ
czech semantic embeddings
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
AI
Ailo340m v4
Ailo · xxrickyxx
Params341M
Context1K
Smallest0.7 GB
CU
Custom KoLLM 13B v6 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB