GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai Command A 03 2025 Abliterated
Command R · mradermacher
Params111B
Context128K
Smallest24.6 GB
Tool use
LF
LFM2 700M GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params742M
Context125K
Q4_K_M0.5 GB
ReasoningTool use
CR
Creative Writer Plus 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
XL
Models Salesforce xLAM 1b Fc R
Xlam · MaziyarPanahi
Params1.35B
Context16K
Smallest1.0 GB
Tool use
GP
TextBase Gpt Oss 20b 0120
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
MI
silvercoder67/Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
OM
OGNO 7B
Omningotex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CarbonVillain en 10.7B v1 i1
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LY
nbeerbower/Lyra4-Gutenberg-12B
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
IC
Ice0.40 20.11 RP
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NO
Noromaid 13b v0.2
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
GGUF
HA
Sao10K/L3.1-70B-Hanami-x1
Hanami · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
GGUF
AN
decapoda-research/Antares-11b-v1
Antares · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KU
kukuspice 7B
Kukuspice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
R1 Distill Llama 8B Anima10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
CE
Cerebras GPT 590M
mradermacher
Params590M
Context2K
Q4_K_M0.4 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.4.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
IC
IceMedovukhaRP 7b
Icemedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceAbsintheLoucheV2RP 7b
Iceabsinthelouchev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
icefog72/IceCaffeLatteRP-7b
Icecaffelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BU
TeeZee/Buttocks-7B-v1.0
Buttocks · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NeverSleep Lumimaid v0.2 12B
Neversleep · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-500total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RO
rost 1b instruct v2
Rost · stefaniancu
Params1.38B
Context4K
Q4_K_M0.8 GB
GGUF
YL
yleo OgnoMonarch 7B
Yleo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
c4ai command r v01
Command R · nold
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
QW
Eagle2-9B
Qwen · Mungert
Params7.61B
Context32K
Q4_K_M4.8 GB
Tool useVision
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing