GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sakura SOLAR Instruct DPO v2
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EF
Efficient Splade VI BT Large Query
Efficient · mradermacher
Params4M
Context512
Q4_K_M0.0 GB
Coding
LL
pub llama 13B v5
Llama · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
CA
CarbonVillain En 10.7B v3
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KE
kekmodel StopCarbon ko 10.7B v3
Kekmodel · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
SO
ft solar 10.7b v2.1 dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.8
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3 8b Instruct Bnb 4bit
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OR
orca dolly 3b
Orca · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
SP
SparkNV Voice
Sparknv · mradermacher
Params507M
Context32K
Q4_K_M0.4 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
OR
Orca_Mini_V2_13B
Orca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
KY
kyujinpy Korean OpenOrca v3
Kyujinpy · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BI
BiMediX Bi
Bimedix · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
Easy Ko Llama3 8b Instruct v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
DopeorNope SOLARC MOE 10.7Bx4
Dopeornope · RichardErkhov
Params36.1B
Context4K
Q4_K_M21.8 GB
GGUF
SA
Sakura SOLRCA Instruct DPO i1
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
Sakura SOLAR
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GA
GaLLM 14B v0.2 i1
Gallm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
LL
NorskGPT Llama3 8b
Llama · bineric
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RA
RAFT 14B
Raft · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
QW
DRT O1 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SO
megastudyedu/M-SOLAR-10.7B-v1.1-beta
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MiraTTS
Miratts · mradermacher
Params507M
Context32K
Q4_K_M0.4 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.0
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KU
Kurugai EEVE v1.1
Kurugai · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
EX
ExTrans 7B
Extrans · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PL
ko platypus kiwi 13B
Platypus · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
DA
Edentns/DataVortexM-7B-Instruct-v0.1
Datavortexm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
youjunhyeok/llama3-koen-8b-sft-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing