GGUF models: cc-by-nc-4.0 license

5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLama 3.1 KazLLM 1.0 8B GGUF4
Llama · issai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BR
BrokenKeyboard
Brokenkeyboardmerge · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
AC
nvidia/AceMath-7B-Instruct
Acemath · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
SO
SJ SOLAR 10.7b DPO
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KU
finch
Kunoichi · antiven0m
Params7.24B
Context32K
Smallest3.5 GB
GGUF
UN
Undi95 MLewdBoros L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AL
AlphaMonarch daser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
MN 12B Mimicore GreenSnake
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ML
MLewd L2 13B v2 2
Mlewd · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
llama 3 Nephilim v2 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AL
Alsebay/L3-krai-test-2
Alsebay · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
icefog72 IceDrinkByFrankensteinV3RP
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IT
ITT Yi Ko 6B v3.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
LU
Model-SafeTensors/Lumimaid-v0.2-70B
Lumimaid · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
OL
vigyan olmoe 1b 7b dpo masterpiece
OLMo · shreyansh12183
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
SU
Sundae v79 4b Thinking
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
CA
CausalLM RP 34B i1
Causallm · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
Roleplay
SU
Sundae v716 Update Direct 4b
Sundae · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
KO
KoQwen_72B_v5.0
Koqwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
CR
Creative Writer 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
GH
ghana voice birifor
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
QW
commitcraft qwen 1.5b lora
Qwen · Shivankar04
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
WE
WEBscrapePL 1.5b
Webscrapepl · mradermacher
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
MI
wkshin89/mistral-7b-instruct-ko-test-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceDrunkCherryV1RP 7b
Icedrunkcherryv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
lynn ko 11b v0.1
Lynn · mradermacher
Params10.8B
Context8K
Q4_K_M6.5 GB
GGUF
MI
Mixtral Erotic 13Bx2 MOE 22B
Mistral · JustData
Params21.5B
Context4K
Smallest17.6 GB
GGUF
IC
IceNalyvkaRP 7b
Icenalyvkarp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing