GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Messier One
Messier · mradermacher
Params4.96B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
AT
Athene-70B
Athene · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MZ
Mzllm Solar 10.7B
Mzllm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AY
Aya Expanse 32b
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
OP
OpenRP 13B SuperCOT i1
Openrp · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TO
TowerInstruct 7B v0.2
Towerinstruct · arzeth
Params6.74B
Context4K
Smallest2.8 GB
GGUF
NY
beberik_nyxene-v2-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
NO
Noromaid 7b v0.2
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ON
SOLAR 10.7B
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MU
facebook/musicgen-large
Musicgen · thepatch
Params58M
Context—
Q4_K_M2.2 GB
GGUF
LL
Llama-3SOME-8B-v2
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
WE
WestLake_Noromaid_OpenHermes_neural Chat
Westlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
qwen 2.5 7b mai friend Q4 K M
Qwen · zadaniamm
Params7.62B
Context32K
Smallest4.7 GB
GGUF
SO
etri-xainlp/SOLAR-10.7B-merge-dpo_v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AC
nvidia.AceInstruct 7B
Aceinstruct · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CU
cuckoo starling 32k 7B i1
Cuckoo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Rivermind 12B v1 Heretic
Rivermind · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
MI
cloudyu Mixtral 7Bx5 MoE 30B
Mistral · RichardErkhov
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
CH
ChatWaifu_72B_v2.2
Chatwaifu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
ReasoningRoleplayTool use
LL
Llama xLAM 2 8b Fc R
Llama · DevQuasar-13
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LA
LaserPipe 7B SLERP i1
Laserpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 11B Alpha
Starling · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
ST
Studybuddy Ai
Studybuddy · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
LL
grimjim/llama-3-Nephilim-v3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
VLAA Thinker Qwen2VL 2B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ReasoningVision
RO
OpenLLM-Ro/RoLlama3-8b-Instruct-2024-06-28
Rollama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CR
Creative Writer Plus 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
FE
Fett Eris Mix 7B i1
Fett · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing