GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
gguf LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
GGUF
LL
Llama 3 8B Instruct ortho baukit toxic n128 v3 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
Ice0.101 20.03 RP GRPO 2 i1
Icelemonmedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
SN
Otter 7B
Sniffyotter · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
WE
WestKunai Hermes 7b
Westkunai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Small NovusKyver
Mistral · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
LY
MN 12B Lyra v4
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
FR
franken kunoichi IDUS 11B
Franken · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
CH
ChatWaifu_v1.3.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
PA
ohyeah1/Pantheon-Hermes-rp
Pantheon · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
RoleplayTool use
QW
Qwen2.5 Coder 7B 20260302
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
LL
Llama-3-Lumimaid-70B-v0.1-alt
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OP
Open_Steuerllm
Open · User954738
Params28B
Context32K
Q4_K_M17.0 GB
GGUF
EX
models--automerger--Neuralsirkrishnaexperiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Undi95 Mistral PetroLimaRP v3 12B
Mistral · RichardErkhov
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
GI
Gilded Arsenic 12B
Gilded · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
MI
K2S3 Mistral 7b v1.3
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
VI
Akiti TTS
Vieneu · michsethowusu
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
RO
RoGemma2 9b Instruct DPO
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
MI
Mixtral 8x7B MoE RP Story i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
AR
Arsenic Shahrazad 12B v4.4.1 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GE
Octopus v2
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
HO
HOTHUN Stheno 3.2 v1.4
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OC
Octopus v2 i1
Octopus · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
BI
Bielik 7B Instruct v0.1
Bielik · oki608900
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
BA
BagelMIsteryTour-8x7B
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing