GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
XL
xLAM 7b fc r
Xlam · QuantFactory
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
LY
MN 12B Lyra v1
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AY
Aya Empati v3
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
TR
Trinas Nectar 8B model stock i1
Trinas · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MY
Myriad 7B Slerp
Myriad · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StartLux Decision v1 0.8B
Startlux · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LL
nvidia/Llama-3.1-8B-UltraLong-1M-Instruct
Llama · DevQuasar-12
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
SO
SOVLish-Devil-8B-L3
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HY
HyouKan 3x7B V2 32k
Hyoukan · mradermacher
Params18.5B
Context32K
Q4_K_M11.4 GB
Roleplay
ST
L3 8B Stheno v3.2 MPOA
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DU
DukunLM 7B V1.0 Uncensored sharded i1
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
AS
Aspire 8B model stock
Aspire · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-Nephilim-v2-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LE
Lewd Sydney 20B
Lewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
UN
Unholy v2 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
CohereLabs.command A Translate 08 2025
Command · DevQuasar
Params111B
Context8K
Q4_K_M67.1 GB
Tool use
AP
AppleSauce L2 13B
Applesauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
Models CohereForAI C4Ai Command A 03 2025
Command R · MaziyarPanahi
Params111B
Context16K
Q4_K_M67.1 GB
Tool use
TI
Tiny Pirate 1.1b v0.2 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TH
Therapybeagle 11B v2 E1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
CY
Cybil-13B
Cybil · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Starling LM 7B alpha
Starling · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
StartLux Decision v1 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
TH
Thanos 3B
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing