GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Relay v0.1 Mistral Nemo 2407
Mistral · danlou
Params12.2B
Context128K
Q4_K_M7.5 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemmasutra Pro 27B v1 i1
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GT
GThinker 7B
Gthinker · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Undi95/Unholy-v2-13B
Unholy · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
HA
Hanames 90B L3.1
Hanames · mradermacher
Params91.9B
Context128K
Smallest34.1 GB
TE
alnrg2arg/test_wanda_240109
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
OM
OmniBeagleSquaredMBX v3 7B
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Instruction Constructionsafety
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
paulml OGNO 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
SLM SQL Base 1.5B
Slm · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
MO
MonarchLake 7B
Monarchlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
Kodonho Solar OrcaDPO Solar Instruct SLERP
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DE
Deacon 20B
Deacon · mradermacher
Params20.1B
Context4K
Q4_K_M12.2 GB
MA
maestrale chat v0.3 beta sft i1
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
OGNO 7B
Parrotogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceAbsintheLoucheRP 7b
Iceabsintheloucherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
XW
Xwin MLewd 13B V0.2
Xwin · Undi95
Params13B
Context4K
Q4_K_M7.9 GB
QW
Monika 122B
Qwen · Green-eyedDevil
Params122B
Context256K
Q4_K_M74.2 GB
LY
MN 12B Lyra v3
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mixtral 4x7B DPO RPChat
Mistral · Undi95
Params24.2B
Context32K
Smallest8.1 GB
LY
Sao10K/MN-12B-Lyra-v2a1
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
MI
nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
ML
MLewdBoros L2 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
IC
IceMoonshineRP 7b
Icemoonshinerp · Casual-Autopsy
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
TE
TextTopic 12B Flash
Texttopic · mradermacher
Params12.3B
Context128K
Q4_K_M7.5 GB