GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
BR
dhanushreddy29/BrokenKeyboard
Brokenkeyboard · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
RO
RoLlama2 7b Instruct DPO
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OU
OuteTTS 0.3 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
WE
WestIceLemonTeaRP 32k
Westicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Ayam-2x8B
Ayam · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
NO
Noromaid 13b v0.1.1
Noromaid · NeverSleep
Params13B
Context4K
Smallest7.4 GB
SO
L3-Solana-8B-v1
Solana · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
AT
Athena v4
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · DarqueDante
Params8.03B
Context128K
Smallest5.7 GB
YU
YuE s2 1B general
Yue · tensorblock
Params1.96B
Context8K
Smallest0.8 GB
GE
GEITje 7B ultra
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 65b Gpt4 1.3
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
MI
cookinai OrcaHermes Mistral 70B miqu
Mistral · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
OM
OmniLing V1 12b experimental i1
Omniling · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
SQ
squarelike korean style converter 6b
Squarelike · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
DA
DataVortexS 10.7B Dpo v1.7
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
AT
Athena v4
Athena · IkariDev
Params13B
Context4K
Smallest6.9 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v4-test
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
HC
Hcx 0.5b Think
Hcx · mradermacher
Params566M
Context8K
Q4_K_M0.4 GB
BE
BenchmarkEngineering F2 7B slerp
Benchmarkengineering · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
RedWhale Tv 10.8B Ipt v0.1
Redwhale · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
BA
MN BackyardAI Party 12B v1
Backyardai · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OG
OGNO 7B
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
LY
Lyra4 Gutenberg 12B
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
IC
IceMochaccinoRP-7b
Icemochaccinorp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen3 1.7b tool calling v4
Qwen · pmrccs
Params1.72B
Context40K
Q4_K_M1.1 GB
NY
L3-Nymeria-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
Undi95_MLewd L2 13B v1 7 TRY2
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KU
kunoichi lemon royale 7B i1
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB