GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Hemmingway 1 NVFP4 MLP
Hemmingway · kvallespin
Params27.3B
Context256K
Smallest20.5 GB
ReasoningTool use
NO
Nox Solar 10.7b v4 Kolon All 5
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
RE
jinaai.ReaderLM v2
Readerlm · DevQuasar-7
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
OM
Omnia2X7B
Omnia · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
AU
Augmentasanguis-8x7B
Augmentasanguis · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mixtral 8x7B MoE RP Story
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
AL
ALoDLM 1.7B
Alodlm · wahidmounir
Params2.03B
Context40K
Smallest2.2 GB
Coding
AI
AIFT Yi Ko 6B v1.11
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
BL
Blind Test
Blind · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PL
PLLuM 8x7B Nc Base
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
ON
oneonlee LDCC SOLAR gugutypus 10.7B
Oneonlee · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
IC
icefog72 IceSakeRP 7b
Icefog · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Noromaid 7B 0.4 DPO
Noromaid · NeverSleep
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10.7b Instruct dpo
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TA
tannedbum L3 Nymeria Maid 8B
Tannedbum · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SP
cstr/Spaetzle-v69-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
FARE 8B
Fare · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Tool use
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AN
Anonymizer 0.6B
Anonymizer · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
IC
Ice0.34n 14.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Fonzie0.1-4B
Qwen · devopsfortunato
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
SH
Shreyansh STEM AI 7B Final
Shreyansh · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
LU
Lumimaid v0.2 12B Heretic
Lumimaid · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Franziska Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AC
nvidia.AceInstruct 1.5B
Aceinstruct · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
BE
beberik rawr
Beberik · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LU
NeverSleep/Lumimaid-v0.2-12B
Lumimaid · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing