GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
KO
KoSOLAR Platypus 10.7B
Kosolar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
GR
grammar synthesis large
Grammar · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
GGUF
EF
Efficient Splade V Large Doc
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Coding
ME
MemoChat Fastchat T5 3B
Memochat · mradermacher
Params2.85B
Context512
Q4_K_M1.8 GB
GGUF
TR
Triplex
Triplex · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
BA
BatchOnline GRPO 1.5B
Batchonline · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
SP
splade cocondenser ensembledistil
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Coding
MI
RAG KO Mixtral 7Bx2 v1.15
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DA
DataVortexS 10.7B v1.0
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
UI Ins 32B
Ins · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
LL
llama2_koen_13b_SFTtrain
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 8B BookAdventures
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SO
kyujinpy/SOLAR-Platypus-10.7B-v2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DR
DRT O1 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
bineric NorskGPT Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
Flan T5 Large Grammar Synthesis v6
Flan · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
GGUF
VO
Voho Saudi Speak 0.6b
Voho · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
TO
Tower 7B D2D
Tower · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 KoEn 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Ko Mixtral v1.3
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
EF
Efficient Splade VI BT Large Doc
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Coding
KO
Kosy Platypus2 13B
Kosy · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 KoEn 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DR
DRT O1 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DP
DPO Think 1.5B
Dpo · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingReasoningTool use
DA
DataVortexM 7B Instruct v0.1
Datavortexm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing