GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Ajibawa 2023 Code 13B
Code · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
NE
neutts nano plt
Neutts · mimba
Params229M
Context2K
Smallest0.2 GB
GGUF
RI
ME 7B v1.1
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Hedoneo L3.1 8B v1.2 Q8 0
Hedoneo · Kaoeiri
Params8.03B
Context8K
Smallest8.5 GB
GGUF
KE
Keiana-L3-Test6.25-8B-18.5
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
AI
AiMaven Merkaba 2.0 Q4 K M
Aimaven · jefferylovely
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PO
Polyglot 8x7b v0.1
Polyglot · macadeliccc
Params46.7B
Context32K
Smallest49.6 GB
GGUF
AK
AkiroXEntro-7B-1-V1
Akiroxentro · mradermacher
Params7.25B
Context8K
Q4_K_M4.4 GB
GGUF
SC
C2S Scale Pythia 1b Pt
Scale · joshloecker
Params1.01B
Context8K
Q4_K_M0.7 GB
GGUF
MA
MarioMaven.Q4 K
Mariomaven · jefferylovely
Params7.24B
Context32K
Smallest4.4 GB
GGUF
GP
dutybot
gpt-oss · EryriLabs
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
CO
Ajibawa 2023 Code 33B
Code · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
Coding
JS
JSL MedLlama 3 8B v2.0 Q6 K
Jsl · Axcel1
Params8.03B
Context8K
Smallest6.6 GB
GGUF
ON
OncoReasoning 0526
Oncoreasoning · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
MO
Motacilla cinerea
Motacilla · Cran-May
Params7.62B
Context128K
Smallest5.8 GB
Tool use
XV
xVerify 32B I
Xverify · ggbetz
Params32.8B
Context32K
Smallest34.8 GB
Reasoning
AK
Akshar Nano
Akshar · shreyaschavan11
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
KE
Keiana-L3-Test5.8-8B-14
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
NL
P E4
Nlpark · NLPark
Params7.62B
Context128K
Smallest4.7 GB
GGUF
GE
Gemma3 4B Fine TOONed
Gemma · praiselab-picuslab
Params3.88B
Context128K
Smallest4.1 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · matrixportalx
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
Ajibawa 2023 SlimOrca 13B
Slimorca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GO
GOIDA-0.5B
Goida · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
JS
JSL MedLlama 3 8B v2.0 Q4 K M
Jsl · mannha
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KE
Keiana-L3-Test6.2-8B-18
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
KE
Keiana-L3-Test5.2-8B-8
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
MI
ME MISTRAL 7B v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Velara 11B V2
Velara · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
GGUF
SH
Shi Ci_v3 Robin
Shi · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TA
Talkia n8n Q8 0
Talkia · ShihteSiao
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use

Keep browsing