GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
S SOLAR 10.7B SFT v1.2 i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
SE
Servile Harpsichord Cdpo
Servile · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Dendrite L3 10B iMat
Dendrite · Quant-Cartel
Params9.78B
Context8K
Q4_K_M6.0 GB
GGUF
KU
SanjiWatsuki/Kunoichi-DPO-v2-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
IT
ITT Yi Ko 6B v2.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
SO
SOLAR 10.7B slerp
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
MO
Monarch 7B
Monarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b R
Xlam · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SL
SLM SQL 0.5B
Slm · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
XL
Salesforce xLAM 1b Fc R
Xlam · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Tool use
AR
Arsenic Shahrazad 12B v4.3.2
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct
Llama · Mungert
Params8.04B
Context1048K
Q4_K_M5.1 GB
Tool use
QW
qwen3vl 8b heretic master pe lora v4.1 r32 ep2 20260928
Qwen · pottokao
Params87M
Context—
Smallest0.0 GB
GGUF
UT
UtopiaXL 13B
Utopiaxl · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OM
OmniBeagleMBX v3 7B
Omnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChineseGuard 1.5B
Chineseguard · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
IA
Iambe RP DARE 20b DENSE
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
Roleplay
MI
MN 12B Mimicore Nocturne i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RE
ReMM SLERP L2 13B
Remm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
UN
Unholy v1 12L 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FI
Fimbulvetr 10.7B v1
Fimbulvetr · LoneStriker
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IM
zeng v6 master pe lora v4.1 r32 ep2 20260928
Image · pottokao
Params66M
Context—
Smallest0.0 GB
GGUF
QW
Luqwen 4B
Qwen · LLiserginov
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
LL
Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct
Llama · Mungert
Params8.04B
Context2096K
Q4_K_M5.1 GB
Tool use
WI
maldv/winter-garden-7b-alpha
Winter · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 4B Instruct MetaSecAlign
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
RO
RoLlama3 8b Instruct 2024 06 28
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PI
PistachioAlt Synatra MCS 7B v0.3 RP Slerp
Pistachioalt · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
KU
Kunoichi 7B
Kunoichi · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AC
AceMath 1.5B Instruct
Acemath · mradermacher
Params1.78B
Context4K
Q4_K_M1.1 GB
GGUF

Keep browsing