GGUF models: cc-by-nc-sa-4.0 license
885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.
LL
Bohanlu Taigi Llama 2 Translator 7B
Llama · tensorblock
Params6.94B
Context4K
Smallest2.6 GB
EF
Efficient Splade V Large Query
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
WI
WikiQwen 9B
Wikiqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
huihui qwen35 4b roleplay qlora ms2048 s800
Qwen · zapabobouj
Params4.21B
Context256K
Smallest4.5 GB
LL
Llama 2 Koen 13b
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
MI
MicroTask mini guanaco 200k i1
Microtask · mradermacher
Params86M
Context2K
Q4_K_M0.1 GB
LL
Llama OuteTTS 1.0 1B
Llama · lainlives
Params1.25B
Context128K
Q4_K_M0.8 GB
DO
DOCR Inspector 7B
Docr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
Taigi-Llama-2-13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
LL
Lilith AI 8B
Llama · CMM7590
Params8.03B
Context128K
Q4_K_M4.9 GB
KY
kyujinpy Sakura SOLRCA Instruct DPO
Kyujinpy · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
NovaSoul 35B A2.6B v10
Qwen · rainstorm130
Params34.7B
Context256K
Q4_K_M21.2 GB
ME
Mermaid 13B
Mermaid · mradermacher
Params13.5B
Context4K
Q4_K_M8.1 GB
CU
Custom KoLLM 13B v6 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
UN
UNAversal 8x7B v1beta
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
ME
MediX R1 8B
Medix · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
ROLEPL AI v2 Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
Math Physics Qwen3.6 10.5B
Qwen · heack
Params10.5B
Context256K
Q4_K_M6.5 GB
ZO
zoyllm 7b slimorca i1
Zoyllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MediX R1 2B
Medix · MBZUAI
Params2.03B
Context256K
Q4_K_M1.3 GB
QW
SlurmPilot 4B
Qwen · gparitosh007
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
Llama-3-KoEn-8B-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Vision Braille Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
DA
DataVortexTL 1.1B v0.1
Datavortextl · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
SE
Seagull 13b translation
Seagull · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
DR
DRT O1 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
SE
SecuCoder
Secucoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB