GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
ME
Messier One
Messier · mradermacher
Params4.96B
Context256K
Q4_K_M3.1 GB
AT
Athene-70B
Athene · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
MZ
Mzllm Solar 10.7B
Mzllm · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
AY
Aya Expanse 32b
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
OP
OpenRP 13B SuperCOT i1
Openrp · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
TO
TowerInstruct 7B v0.2
Towerinstruct · arzeth
Params6.74B
Context4K
Smallest2.8 GB
NY
beberik_nyxene-v2-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
NO
Noromaid 7b v0.2
Noromaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ON
SOLAR 10.7B
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
MU
facebook/musicgen-large
Musicgen · thepatch
Params58M
Context—
Q4_K_M2.2 GB
LL
Llama-3SOME-8B-v2
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
WE
WestLake_Noromaid_OpenHermes_neural Chat
Westlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen 2.5 7b mai friend Q4 K M
Qwen · zadaniamm
Params7.62B
Context32K
Smallest4.7 GB
SO
etri-xainlp/SOLAR-10.7B-merge-dpo_v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LU
LUNA SOLARkrautLM Instruct
Luna · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AC
nvidia.AceInstruct 7B
Aceinstruct · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
CU
cuckoo starling 32k 7B i1
Cuckoo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Rivermind 12B v1 Heretic
Rivermind · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
MI
cloudyu Mixtral 7Bx5 MoE 30B
Mistral · RichardErkhov
Params29.8B
Context32K
Q4_K_M18.0 GB
CH
ChatWaifu_72B_v2.2
Chatwaifu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Llama xLAM 2 8b Fc R
Llama · DevQuasar-13
Params8.03B
Context128K
Q4_K_M4.9 GB
LA
LaserPipe 7B SLERP i1
Laserpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Starling LM 11B Alpha
Starling · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
ST
Studybuddy Ai
Studybuddy · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
LL
grimjim/llama-3-Nephilim-v3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
VLAA Thinker Qwen2VL 2B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
RO
OpenLLM-Ro/RoLlama3-8b-Instruct-2024-06-28
Rollama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CR
Creative Writer Plus 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
FE
Fett Eris Mix 7B i1
Fett · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB