GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
TH
therapybeagle-11B-v2-e2
Therapybeagle · victunes
Params10.7B
Context32K
Q4_K_M6.5 GB
SO
K2S3 SOLAR 11b v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
Dawn v2 70B
Dawn · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
AC
AceInstruct-1.5B
Aceinstruct · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
CH
ChineseGuard 3B
Chineseguard · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
HE
Hemmingway 1.5 NVFP4
Hemmingway · kvallespin
Params27.3B
Context256K
Smallest20.5 GB
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
PI
PistachioAlt Noromaid Bagel 7B Slerp
Pistachioalt · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceMochaccinoRP-7b
Icemochaccinorp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
L3-Nymeria-Maid-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SU
Sundae v716 Update Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · Peeb22557
Params8.03B
Context8K
Q4_K_M4.9 GB
SL
SLM SQL 1.3B
Slm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
KA
Kallamni 2.6b v1
Kallamni · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
MI
indischepartij OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
CoALM 8B i1
Coalm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
undi95_bigplap-8x20b
Bigplap · TheBloke
Params112B
Context32K
Smallest39.4 GB
ER
eren23 ogno monarch jaskier merge 7b v2
Eren · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
Thanos 1B
Thanos · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
AL
Alphacode-AI/AlphaMist7B-slr-v1
Alphacode · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama3 8b Instruct
Rollama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
C4AI Command R7B
Command R · dranger003
Params8.03B
Context8K
Smallest5.1 GB
LL
Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
Llama · Mungert
Params8.04B
Context4192K
Q4_K_M5.1 GB
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
RH
L3 Rhaenys 8B i1
Rhaenys · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
C4Ai Command A 03 2025
Command R · lmstudio-community
Params111B
Context16K
Q4_K_M67.1 GB
KU
grimjim/kunoichi-lemon-royale-v2-32K-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Seraph 7B i1
Seraph · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB