GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CO
C4Ai Command A 03 2025 Abliterated
Command R · mradermacher
Params111B
Context128K
Smallest24.6 GB
LF
LFM2 700M GRPO NuminaMath 10K
Lfm · ermiaazarkhalili
Params742M
Context125K
Q4_K_M0.5 GB
CR
Creative Writer Plus 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
XL
Models Salesforce xLAM 1b Fc R
Xlam · MaziyarPanahi
Params1.35B
Context16K
Smallest1.0 GB
GP
TextBase Gpt Oss 20b 0120
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
silvercoder67/Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
OGNO 7B
Omningotex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
CarbonVillain en 10.7B v1 i1
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LY
nbeerbower/Lyra4-Gutenberg-12B
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
IC
Ice0.40 20.11 RP
Icedrunkencherryrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Noromaid 13b v0.2
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
HA
Sao10K/L3.1-70B-Hanami-x1
Hanami · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
AN
decapoda-research/Antares-11b-v1
Antares · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
KU
kukuspice 7B
Kukuspice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
R1 Distill Llama 8B Anima10
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CE
Cerebras GPT 590M
mradermacher
Params590M
Context2K
Q4_K_M0.4 GB
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.4.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceMedovukhaRP 7b
Icemedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceAbsintheLoucheV2RP 7b
Iceabsinthelouchev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
icefog72/IceCaffeLatteRP-7b
Icecaffelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BU
TeeZee/Buttocks-7B-v1.0
Buttocks · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NeverSleep Lumimaid v0.2 12B
Neversleep · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-500total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
RO
rost 1b instruct v2
Rost · stefaniancu
Params1.38B
Context4K
Q4_K_M0.8 GB
YL
yleo OgnoMonarch 7B
Yleo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
c4ai command r v01
Command R · nold
Params35B
Context128K
Q4_K_M21.5 GB
QW
Eagle2-9B
Qwen · Mungert
Params7.61B
Context32K
Q4_K_M4.8 GB
LL
Llama 3.1 8B Stheno v3.4 Heretic
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · tensorblock
Params10.7B
Context4K
Smallest4.0 GB