GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
TH
therapybeagle-11B-v2-e2
Therapybeagle · victunes
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
SO
K2S3 SOLAR 11b v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
Dawn v2 70B
Dawn · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AC
AceInstruct-1.5B
Aceinstruct · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
Coding
CH
ChineseGuard 3B
Chineseguard · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
HE
Hemmingway 1.5 NVFP4
Hemmingway · kvallespin
Params27.3B
Context256K
Smallest20.5 GB
ReasoningTool use
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
PI
PistachioAlt Noromaid Bagel 7B Slerp
Pistachioalt · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceMochaccinoRP-7b
Icemochaccinorp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
L3-Nymeria-Maid-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
SU
Sundae v716 Update Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · Peeb22557
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SL
SLM SQL 1.3B
Slm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
KA
Kallamni 2.6b v1
Kallamni · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
MI
indischepartij OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
CoALM 8B i1
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BI
undi95_bigplap-8x20b
Bigplap · TheBloke
Params112B
Context32K
Smallest39.4 GB
GGUF
ER
eren23 ogno monarch jaskier merge 7b v2
Eren · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
Thanos 1B
Thanos · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AL
Alphacode-AI/AlphaMist7B-slr-v1
Alphacode · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoLlama3 8b Instruct
Rollama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
C4AI Command R7B
Command R · dranger003
Params8.03B
Context8K
Smallest5.1 GB
Tool use
LL
Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
Llama · Mungert
Params8.04B
Context4192K
Q4_K_M5.1 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
RH
L3 Rhaenys 8B i1
Rhaenys · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
CO
C4Ai Command A 03 2025
Command R · lmstudio-community
Params111B
Context16K
Q4_K_M67.1 GB
Tool use
KU
grimjim/kunoichi-lemon-royale-v2-32K-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
Seraph 7B i1
Seraph · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing