GGUF models: cc-by-nc-sa-4.0 license

885 GGUF models listed under the cc-by-nc-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GA
GaLLM 14B v0.1
Gallm · TransWithAI
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
FR
Frankenstein MoE En 10.7Bx6
Frankenstein · mradermacher
Params53B
Context4K
Q4_K_M32.1 GB
GGUF
RA
Elte nlp.Racka 4B
Racka · DevQuasar
Params4.02B
Context40K
Smallest1.7 GB
ReasoningTool use
LL
Taigi-Llama-2-Translator-13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.0
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
kyujinpy/Sakura-SOLAR-Instruct
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v1
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ME
Merge Sakura Solar i1
Merge · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OO
OOM 13B 02
Oom · mradermacher
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
ME
MemoChat Vicuna 33B
Memochat · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ME
MediX R1 2B
Medix · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GR
Grammar Synthesis Small WIP
Grammar · mradermacher
Params77M
Context512
Q4_K_M0.1 GB
GGUF
LL
Llama 3.1 Spellbound StoryWriter 70b instruct 0.4 16bit i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
SP
Splade Code 06B
Splade · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
Coding
SO
PracticeLLM/SOLAR-tail-10.7B-instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
TinyTalk 2
Tinytalk · TheREZOR
Params19M
Context256
Smallest0.0 GB
GGUF
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
HY
theNovaAI/Hypernova-experimental
Hypernova · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
Sakura SOLRCA Math Instruct DPO v1
Sakura · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoT platypus2 7B
Kot · mradermacher
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
BA
BatchOnline GRPO 14B
Batchonline · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
SA
Sakura SOLAR Instruct DPO v2
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
kyujinpy/Korean-OpenOrca-v3
Korean · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FL
Flan T5 Xl Grammar Synthesis
Flan · pszemraj
Params2.85B
Context512
Smallest2.3 GB
GGUF
SO
SOLAR Platypus 10.7B v1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Taigi Llama 2 Chat 13B
Llama · mradermacher
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
QW
ToolRM Gen Qwen3 4B Thinking 2507
Qwen · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
DA
DataVortexS 10.7B Dpo v1.5
Datavortexs · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
Calypso 3B alpha v2
Calypso · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
GGUF

Keep browsing