GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Relay v0.1 Mistral Nemo 2407
Mistral · danlou
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Gemmasutra Pro 27B v1 i1
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GT
GThinker 7B
Gthinker · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Undi95/Unholy-v2-13B
Unholy · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HA
Hanames 90B L3.1
Hanames · mradermacher
Params91.9B
Context128K
Smallest34.1 GB
GGUF
TE
alnrg2arg/test_wanda_240109
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OM
OmniBeagleSquaredMBX v3 7B
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Instruction Constructionsafety
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
paulml OGNO 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
SLM SQL Base 1.5B
Slm · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
MO
MonarchLake 7B
Monarchlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
Kodonho Solar OrcaDPO Solar Instruct SLERP
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DE
Deacon 20B
Deacon · mradermacher
Params20.1B
Context4K
Q4_K_M12.2 GB
GGUF
MA
maestrale chat v0.3 beta sft i1
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
OGNO 7B
Parrotogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceAbsintheLoucheRP 7b
Iceabsintheloucherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XW
Xwin MLewd 13B V0.2
Xwin · Undi95
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Monika 122B
Qwen · Green-eyedDevil
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningRoleplayTool use
LY
MN 12B Lyra v3
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 4x7B DPO RPChat
Mistral · Undi95
Params24.2B
Context32K
Smallest8.1 GB
GGUF
LY
Sao10K/MN-12B-Lyra-v2a1
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MI
nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ML
MLewdBoros L2 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IC
IceMoonshineRP 7b
Icemoonshinerp · Casual-Autopsy
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
TE
TextTopic 12B Flash
Texttopic · mradermacher
Params12.3B
Context128K
Q4_K_M7.5 GB
Tool use

Keep browsing