GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
BeagSake 7B
Beagsake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
factusight 9B
Qwen · manuelgscom
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
MA
Mantis 50M
Mantis · kash8080
Params49M
Context1K
Smallest0.1 GB
GGUF
PS
psarai_speech_stage_s15nn9in
Psarai · nphearum
Params93M
Context—
Smallest0.4 GB
GGUF
ST
StartLux Decision v1 9B BF16
Startlux · startlux-models
Params8.95B
Context256K
Smallest17.9 GB
GGUF
RH
L3 Rhaenys 8B
Rhaenys · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
BI
BigL 7B i1
Bigl · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alsebay/Narumashi-RT-11B
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TO
Undi95/Toppy-M-7B
Toppy · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
LL
NeverSleep Llama 3 Lumimaid 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LO
Loyal Macaroni Maid 7B
Loyal · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
IA
Iambe RP cDPO 20b
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
Roleplay
LL
Llama 3.1 Arctic ExCoT 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
SP
Spaetzle v85 7b
Spaetzle · cstr
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
MM ReMM L2 20B
Remm · tensorblock
Params20B
Context4K
Smallest7.4 GB
GGUF
BT
4BTestRC
Btestrc · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
GGUF
CH
ChatWaifu_22B_v2.0_preview
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
ReasoningRoleplay
OM
OmniLing V1 12b experimental
Omniling · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
NO
NeverSleep Noromaid 13b v0.2
Noromaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
TH
Thespis Krangled 7b
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
Yue2 3B GGUF Quantized
Yue · jagamypriera
Params3.63B
Context—
Smallest0.3 GB
GGUF
PA
paulml OmniBeagleSquaredMBX v3 7B v2
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniusLight 24B v1.01
Miniuslight · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
TE
Tessera 4B Preview
Tessera · sahilchachra
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
NE
Monarch 7B
Neuralmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
cstr/Spaetzle-v60-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Command A 03 2025 Writer v1
Command · mradermacher
Params111B
Context128K
Smallest42.1 GB
Tool use
DE
Deacon 1b
Deacon · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing