GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LA
gguf LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
LL
Llama 3 8B Instruct ortho baukit toxic n128 v3 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
Ice0.101 20.03 RP GRPO 2 i1
Icelemonmedovukharp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SN
Otter 7B
Sniffyotter · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
WE
WestKunai Hermes 7b
Westkunai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small NovusKyver
Mistral · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
LY
MN 12B Lyra v4
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
FR
franken kunoichi IDUS 11B
Franken · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
CH
ChatWaifu_v1.3.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
PA
ohyeah1/Pantheon-Hermes-rp
Pantheon · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 7B 20260302
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama-3-Lumimaid-70B-v0.1-alt
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
OP
Open_Steuerllm
Open · User954738
Params28B
Context32K
Q4_K_M17.0 GB
EX
models--automerger--Neuralsirkrishnaexperiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Undi95 Mistral PetroLimaRP v3 12B
Mistral · RichardErkhov
Params11.2B
Context32K
Q4_K_M6.7 GB
GI
Gilded Arsenic 12B
Gilded · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
MI
K2S3 Mistral 7b v1.3
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
VI
Akiti TTS
Vieneu · michsethowusu
Params244M
Context4K
Q4_K_M0.2 GB
RO
RoGemma2 9b Instruct DPO
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mixtral 8x7B MoE RP Story i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AR
Arsenic Shahrazad 12B v4.4.1 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Octopus v2
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
HO
HOTHUN Stheno 3.2 v1.4
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OC
Octopus v2 i1
Octopus · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
BI
Bielik 7B Instruct v0.1
Bielik · oki608900
Params7.24B
Context4K
Q4_K_M4.4 GB
BA
BagelMIsteryTour-8x7B
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB