GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
PL
PLLuM 12B nc instruct 2412 i1
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2.5 Aloe Beta 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
AY
aya-23-8B
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
LY
Lyra4 Gutenberg 12B i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
NA
Naluri 561M Encoder
Naluri · mradermacher
Params559M
Context512
Q4_K_M0.4 GB
DE
Vigyan 1.5B 4x MoE
DeepSeek · Experimentlab
Params6.4B
Context128K
Q4_K_M3.9 GB
TH
L3 TheGreenLion 8b SFT v0.1.2
Thegreenlion · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
L3 SAO MIX 8B V1 i1
Sao · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceMartiniV1RP 7b
Icemartiniv · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
AY
Aya Medikal V2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
CO
CohereLabs.c4ai Command R v01
Command R · DevQuasar
Params35B
Context128K
Q4_K_M21.5 GB
CO
c4ai-command-r-plus
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
TI
Tiny Viking 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
LDCC Instruct Llama 2 Ko 13B v4
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
RA
raon-opentts-0.3b-f16
Raon · cstr
Params353M
Context—
Smallest1.0 GB
CO
C4Ai Command A 03 2025
Command R · mradermacher
Params111B
Context16K
Smallest24.6 GB
LL
badger writer llama 3 8b i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
RoLlama2-7b-Chat
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
PsychoCounsel Llama3 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Dendrite-L3-10B
Dendrite · mradermacher
Params9.78B
Context8K
Q4_K_M6.0 GB
MY
models--automerger--MyriadStrangemerges_32-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ES
MN 12B Estrella v2.2
Estrella · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OC
octo planner
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
HE
Hemmingway 1 Heretic
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MO
Monika 122B
Monika · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
DO
Dolphin Xgen RL
Dolphin · mradermacher
Params10.7B
Context256K
Q4_K_M6.5 GB