GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
KO
KoSOLAR Platypus 10.7B
Kosolar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GR
grammar synthesis large
Grammar · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
EF
Efficient Splade V Large Doc
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
ME
MemoChat Fastchat T5 3B
Memochat · mradermacher
Params2.85B
Context512
Q4_K_M1.8 GB
TR
Triplex
Triplex · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
BA
BatchOnline GRPO 1.5B
Batchonline · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
SP
splade cocondenser ensembledistil
Splade · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
MI
RAG KO Mixtral 7Bx2 v1.15
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
DA
DataVortexS 10.7B v1.0
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
IN
UI Ins 32B
Ins · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
LL
llama2_koen_13b_SFTtrain
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
Llama 3.1 8B BookAdventures
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
kyujinpy/SOLAR-Platypus-10.7B-v2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
DR
DRT O1 14B
Drt · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama-3-KoEn-8B-Instruct-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
bineric NorskGPT Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
Flan T5 Large Grammar Synthesis v6
Flan · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
VO
Voho Saudi Speak 0.6b
Voho · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
TO
Tower 7B D2D
Tower · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 KoEn 8B i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Ko Mixtral v1.3
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
DA
DataVortexS 10.7B Dpo v1.6
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
EF
Efficient Splade VI BT Large Doc
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
KO
Kosy Platypus2 13B
Kosy · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 3 KoEn 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DR
DRT O1 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DP
DPO Think 1.5B
Dpo · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DA
DataVortexM 7B Instruct v0.1
Datavortexm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB