GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GGUF
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
maywell_synatra-v0.1-7b-instruct
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
vagosolutions_sauerkrautlm-solar-instruct
Sauerkrautlm · TheBloke
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
FI
Fimbulvetr 11B v2 iMat
Fimbulvetr · InferenceIllusionist
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SO
Solstice-11B-v1
Solstice · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Chronos Gold 12B 1.0
Chronos · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
cloudyu_mixtral_34bx2_moe_60b
Mistral · TheBloke
Params60.8B
Context195K
Q4_K_M34.4 GB
GGUF
PI
ddh0_pirouette-7b
Pirouette · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy i1
Llama · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
GGUF
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
QW
Hemmingway 1 Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
GGUF
MX
MXLewdMini L2 13B
Mxlewdmini · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing