GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
DAVinCI Yi Ko 6B v0.8
Davinci · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
SO
SOLAR 10.7B Merge Dpo_V1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
HA
Hammer2.1 1.5b
Hammer · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
UndiMix v4 13B i1
Undimix · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
airoboros 33b gpt4 m2.0 i1
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · lmstudio-community
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
AI
Airoboros 13b Gpt4 1.4
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PR
proxy lite 3b i1
Proxy · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool use
LU
Lumimaid v0.2 12B i1
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TI
CohereLabs.tiny Aya Global
Tiny · DevQuasar
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
GE
GEITje 7B ultra i1
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
Loyal Macaroni Maid 7B i1
Loyal · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OC
octopus planning i1
Octopus · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
GE
Gemmasutra Pro 27B V1F
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
CR
Creative Writer 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
CL
CleverMommy mix 20b
Clevermommy · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
CA
CATA-LimaRP-Zloss-DT-TaskArithmetic-8x7B
Cata · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TE
Teuken 7B Base v0.6
Teuken · shahzeb171
Params8.48B
Context4K
Smallest3.8 GB
GGUF
AC
AceInstruct 1.5B
Aceinstruct · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
NE
Neeto 1.0 8b
Neeto · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IA
Iambe RP DARE 20b DENSE i1
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
Roleplay
AL
AlphaMonarch 7B
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cloudyu Mixtral 7Bx2 MoE 13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
ML
MLewd L2 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LY
MN 12B Lyra v3
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
INFIndo Qwen3 32B Preview
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Tool use
LL
LDCC Instruct Llama 2 Ko 13B v4.1.8
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing