GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PL
PLLuM 12B nc instruct 2412 i1
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 Aloe Beta 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
AY
aya-23-8B
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LY
Lyra4 Gutenberg 12B i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
NA
Naluri 561M Encoder
Naluri · mradermacher
Params559M
Context512
Q4_K_M0.4 GB
Coding
DE
Vigyan 1.5B 4x MoE
DeepSeek · Experimentlab
Params6.4B
Context128K
Q4_K_M3.9 GB
ReasoningTool use
TH
L3 TheGreenLion 8b SFT v0.1.2
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
L3 SAO MIX 8B V1 i1
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceMartiniV1RP 7b
Icemartiniv · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
AY
Aya Medikal V2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
CO
CohereLabs.c4ai Command R v01
Command R · DevQuasar
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
c4ai-command-r-plus
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
TI
Tiny Viking 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v4
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
RA
raon-opentts-0.3b-f16
Raon · cstr
Params353M
Context—
Smallest1.0 GB
GGUF
CO
C4Ai Command A 03 2025
Command R · mradermacher
Params111B
Context16K
Smallest24.6 GB
Tool use
LL
badger writer llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
RoLlama2-7b-Chat
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
Dendrite-L3-10B
Dendrite · mradermacher
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF
MY
models--automerger--MyriadStrangemerges_32-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ES
MN 12B Estrella v2.2
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OC
octo planner
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
HE
Hemmingway 1 Heretic
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Tool useVision
MO
Monika 122B
Monika · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningRoleplayTool use
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DO
Dolphin Xgen RL
Dolphin · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB
GGUF

Keep browsing