GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LL
youjunhyeok llama3 koen sft dpo v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Wngkdud llama2_koen_13b_SFTtrain
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
SH
gguf Sheared Pythia 160m Platypus
Sheared · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
MI
NorskGPT Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
PlatYi 34B Q
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
AU
audioldm2
Audioldm · vokra
Params1.12B
Context—
Smallest4.5 GB
CA
caudwell 9b v0 Q6 K
Caudwell · steinzer-narayan
Params9.24B
Context8K
Smallest7.6 GB
ME
Medit Xl
Medit · aynig
Params8M
Context—
Smallest0.0 GB
LL
Taigi Llama 2 Chat 7B
Llama · Bohanlu
Params6.94B
Context4K
Q4_K_M4.2 GB
LL
Llama-3-Soliloquy-8B
Llama · delijoe
Params8.03B
Context24K
Smallest8.5 GB
DO
DopeorNope SOLARC MOE 10.7Bx6
Dopeornope · RichardErkhov
Params53B
Context4K
Q4_K_M32.1 GB
MP
Mpt 7b 8k Chat
Mpt · Stormtrooperaim
Params6.65B
Context8K
Smallest3.6 GB
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest8.5 GB
BI
bicodec
Bicodec · vokra
Params156M
Context—
Smallest0.6 GB
LL
AISquare Instruct llama2 koen 13b v0.9.18
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
DE
Dev 4B
Dev · suhaas-teja
Params33M
Context—
Smallest0.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · jackboyla
Params3.82B
Context4K
Smallest4.1 GB
MK
MKLLM 7B Instruct Q4 0
Mkllm · cigol123
Params7.24B
Context32K
Smallest4.1 GB
OO
OOM 13B 02 i1
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
OM
OmniChem 7B v1
Omnichem · aboltuss124
Params7.61B
Context32K
Q4_K_M4.7 GB
ST
Stable Platypus2 13B
Stable · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest5.7 GB
CU
Custom KoLLM 13B v5 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
DR
DRT O1 14B
Drt · shuishan
Params14.8B
Context32K
Smallest15.7 GB
ST
StopCarbon 10.7B v5
Stopcarbon · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PA
Pasa 7b Selector
Pasa · sakura1225
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistralopithecus v0.1 10.8B
Mistral · tensorblock
Params10.8B
Context32K
Smallest4.1 GB
PL
ko platypus kiwi 13B Q4 K M
Platypus · aumosita
Params13B
Context2K
Q4_K_M7.9 GB
NI
nisqa v2 weight
Nisqa · vokra
Params—
Context—
Smallest0.0 GB
ME
MermaidSolar Q4 K S
Mermaidsolar · danielus
Params10.7B
Context4K
Smallest6.1 GB