GGUF models: cc-by-nc-4.0 license
5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.
LL
LLama 3.1 KazLLM 1.0 8B GGUF4
Llama · issai
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
BrokenKeyboard
Brokenkeyboardmerge · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
AC
nvidia/AceMath-7B-Instruct
Acemath · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
SO
SJ SOLAR 10.7b DPO
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
KU
finch
Kunoichi · antiven0m
Params7.24B
Context32K
Smallest3.5 GB
UN
Undi95 MLewdBoros L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AL
AlphaMonarch daser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MN 12B Mimicore GreenSnake
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ML
MLewd L2 13B v2 2
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
LL
llama 3 Nephilim v2 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
Alsebay/L3-krai-test-2
Alsebay · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
icefog72 IceDrinkByFrankensteinV3RP
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IT
ITT Yi Ko 6B v3.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
LU
Model-SafeTensors/Lumimaid-v0.2-70B
Lumimaid · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
OL
vigyan olmoe 1b 7b dpo masterpiece
OLMo · shreyansh12183
Params6.92B
Context4K
Q4_K_M4.2 GB
SU
Sundae v79 4b Thinking
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CA
CausalLM RP 34B i1
Causallm · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
SU
Sundae v716 Update Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
KO
KoQwen_72B_v5.0
Koqwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CR
Creative Writer 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GH
ghana voice birifor
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
QW
commitcraft qwen 1.5b lora
Qwen · Shivankar04
Params1.54B
Context32K
Q4_K_M1.0 GB
WE
WEBscrapePL 1.5b
Webscrapepl · mradermacher
Params1.54B
Context501K
Q4_K_M1.0 GB
MI
wkshin89/mistral-7b-instruct-ko-test-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceDrunkCherryV1RP 7b
Icedrunkcherryv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
lynn ko 11b v0.1
Lynn · mradermacher
Params10.8B
Context8K
Q4_K_M6.5 GB
MI
Mixtral Erotic 13Bx2 MOE 22B
Mistral · JustData
Params21.5B
Context4K
Smallest17.6 GB
IC
IceNalyvkaRP 7b
Icenalyvkarp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB