GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
youjunhyeok llama3 koen sft dpo v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Wngkdud llama2_koen_13b_SFTtrain
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
SH
gguf Sheared Pythia 160m Platypus
Sheared · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
MI
NorskGPT Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
PlatYi 34B Q
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
AU
audioldm2
Audioldm · vokra
Params1.12B
Context—
Smallest4.5 GB
GGUF
CA
caudwell 9b v0 Q6 K
Caudwell · steinzer-narayan
Params9.24B
Context8K
Smallest7.6 GB
GGUF
ME
Medit Xl
Medit · aynig
Params8M
Context—
Smallest0.0 GB
GGUF
LL
Taigi Llama 2 Chat 7B
Llama · Bohanlu
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama-3-Soliloquy-8B
Llama · delijoe
Params8.03B
Context24K
Smallest8.5 GB
GGUF
DO
DopeorNope SOLARC MOE 10.7Bx6
Dopeornope · RichardErkhov
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
MP
Mpt 7b 8k Chat
Mpt · Stormtrooperaim
Params6.65B
Context8K
Smallest3.6 GB
Coding
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest8.5 GB
GGUF
BI
bicodec
Bicodec · vokra
Params156M
Context—
Smallest0.6 GB
GGUF
LL
AISquare Instruct llama2 koen 13b v0.9.18
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
DE
Dev 4B
Dev · suhaas-teja
Params33M
Context—
Smallest0.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · jackboyla
Params3.82B
Context4K
Smallest4.1 GB
GGUF
MK
MKLLM 7B Instruct Q4 0
Mkllm · cigol123
Params7.24B
Context32K
Smallest4.1 GB
GGUF
OO
OOM 13B 02 i1
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
OM
OmniChem 7B v1
Omnichem · aboltuss124
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
ST
Stable Platypus2 13B
Stable · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · Recaru
Params8.03B
Context8K
Smallest5.7 GB
GGUF
CU
Custom KoLLM 13B v5 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
DR
DRT O1 14B
Drt · shuishan
Params14.8B
Context32K
Smallest15.7 GB
Tool use
ST
StopCarbon 10.7B v5
Stopcarbon · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PA
Pasa 7b Selector
Pasa · sakura1225
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MI
Mistralopithecus v0.1 10.8B
Mistral · tensorblock
Params10.8B
Context32K
Smallest4.1 GB
GGUF
PL
ko platypus kiwi 13B Q4 K M
Platypus · aumosita
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NI
nisqa v2 weight
Nisqa · vokra
Params—
Context—
Smallest0.0 GB
GGUF
ME
MermaidSolar Q4 K S
Mermaidsolar · danielus
Params10.7B
Context4K
Smallest6.1 GB
GGUF

Keep browsing