GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AC
E1 AceReason 14B
Acereason · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
ReasoningTool use
LL
PatronusAI Llama 3 Patronus Lynx 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
chronos 70b v2 i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
Roleplay
BE
BeagSake 7B i1
Beagsake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
chargoddard_mixtralnt-4x7b-test
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
PA
jackrabbit-110m-ro.f32
Parakeet · surogate
Params122M
Context—
Smallest0.1 GB
GGUF
OC
Octen WebGR 4B
Octen · mradermacher
Params4.36B
Context32K
Q4_K_M2.8 GB
ReasoningTool use
QW
Qwen2.5 Aloe Beta 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
CO
c4ai command r v01
Command R · andrewcanis
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct i1
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
ST
StartLux Decision v1 27B
Startlux · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
CR
Crystal 0.8b
Crystal · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Sao10K/Llama-3.1-8B-Stheno-v3.4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Ortho-SOVL-8B-L3
Ortho · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AN
Antares 11b v1 i1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
AY
Ayam-2x8B
Ayam · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
GE
gemmaExtract
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GGUF
LL
Llama 3.1 8B UltraLong 2M Instruct
Llama · bartowski
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
OP
OpenLLM Ro RoLlama2 7b Instruct 2024 05 14
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SO
SOVLish-Maid-L3-8B
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · BricksDisplay
Params85M
Context—
Q4_K_M0.1 GB
GGUF
MA
Magrathic 12B
Magrathic · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TO
undi95_toppy-m-7b
Toppy · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
LUNA SOLARkrautLM Instruct i1
Luna · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Keep browsing