GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Bohanlu Taigi Llama 2 Translator 7B
Llama · tensorblock
Params6.94B
Context4K
Smallest2.6 GB
GGUF
EF
Efficient Splade V Large Query
Efficient · mradermacher
Params66M
Context512
Q4_K_M0.0 GB
Coding
WI
WikiQwen 9B
Wikiqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
huihui qwen35 4b roleplay qlora ms2048 s800
Qwen · zapabobouj
Params4.21B
Context256K
Smallest4.5 GB
ReasoningRoleplayTool use
LL
Llama 2 Koen 13b
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
ReasoningTool use
MI
MicroTask mini guanaco 200k i1
Microtask · mradermacher
Params86M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama OuteTTS 1.0 1B
Llama · lainlives
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
DO
DOCR Inspector 7B
Docr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LL
Taigi-Llama-2-13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
LL
Lilith AI 8B
Llama · CMM7590
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
KY
kyujinpy Sakura SOLRCA Instruct DPO
Kyujinpy · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
NovaSoul 35B A2.6B v10
Qwen · rainstorm130
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
ME
Mermaid 13B
Mermaid · mradermacher
Params13.5B
Context4K
Q4_K_M8.1 GB
GGUF
CU
Custom KoLLM 13B v6 i1
Custom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
UN
UNAversal 8x7B v1beta
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
ME
MediX R1 8B
Medix · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
QW
ROLEPL AI v2 Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
RoleplayTool use
QW
Math Physics Qwen3.6 10.5B
Qwen · heack
Params10.5B
Context256K
Q4_K_M6.5 GB
ReasoningTool use
ZO
zoyllm 7b slimorca i1
Zoyllm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MediX R1 2B
Medix · MBZUAI
Params2.03B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
SlurmPilot 4B
Qwen · gparitosh007
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
LL
Llama-3-KoEn-8B-preview
Llama · teddylee777
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Vision Braille Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool useVision
DA
DataVortexTL 1.1B v0.1
Datavortextl · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SE
Seagull 13b translation
Seagull · mradermacher
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
DR
DRT O1 7B
Drt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.12
Datavortexs · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SE
SecuCoder
Secucoder · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use

Keep browsing