GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BR
dhanushreddy29/BrokenKeyboard
Brokenkeyboard · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
RO
RoLlama2 7b Instruct DPO
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OU
OuteTTS 0.3 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
WE
WestIceLemonTeaRP 32k
Westicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Ayam-2x8B
Ayam · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
NO
Noromaid 13b v0.1.1
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
GGUF
SO
L3-Solana-8B-v1
Solana · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AT
Athena v4
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · DarqueDante
Params8.03B
Context128K
Smallest5.7 GB
GGUF
YU
YuE s2 1B general
Yue · tensorblock
Params1.96B
Context8K
Smallest0.8 GB
GGUF
GE
GEITje 7B ultra
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 65b Gpt4 1.3
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
MI
cookinai OrcaHermes Mistral 70B miqu
Mistral · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
Tool use
OM
OmniLing V1 12b experimental i1
Omniling · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
SQ
squarelike korean style converter 6b
Squarelike · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.7
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
AT
Athena v4
Athena · IkariDev
Params13B
Context4K
Smallest6.9 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v4-test
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HC
Hcx 0.5b Think
Hcx · mradermacher
Params566M
Context8K
Q4_K_M0.4 GB
Reasoning
BE
BenchmarkEngineering F2 7B slerp
Benchmarkengineering · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
RedWhale Tv 10.8B Ipt v0.1
Redwhale · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
BA
MN BackyardAI Party 12B v1
Backyardai · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OG
OGNO 7B
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LY
Lyra4 Gutenberg 12B
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
IC
IceMochaccinoRP-7b
Icemochaccinorp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
qwen3 1.7b tool calling v4
Qwen · pmrccs
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
NY
L3-Nymeria-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ML
Undi95_MLewd L2 13B v1 7 TRY2
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
kunoichi lemon royale 7B i1
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing