GGUF models: cc-by-nc-nd-4.0 license

334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KE
Keiana L3 Test6.2 8B 18
Keiana · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BA
Bald Eagle 7B
Bald · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AU
AuriAetherwiing MN 12B Starcannon v2
Auriaetherwiing · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KE
Keiana-L3-Test5.75-8B-13.5
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
GGUF
AG
Aguie chat proto
Aguie · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
AK
Akshar Nano V2
Akshar · shreyaschavan11
Params1.24B
Context128K
Smallest1.3 GB
GGUF
VE
Velara
Velara · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
DP
ME Dpo 7B v1.1
Dpo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DP
ME Dpo 7B v1.0
Dpo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DO
Dolus 14b Mini Q5 K M
Dolus · Jianping746
Params11.5B
Context8K
Smallest8.2 GB
Reasoning
QW
kagentlms qwen 7b mat
Qwen · kwaikeg
Params7.72B
Context8K
Smallest4.5 GB
GGUF
TH
TheBuddha
Thebuddha · teyler
Params3.21B
Context128K
Smallest6.4 GB
Tool use
HE
Hedone L3.1 8B v1.1 Q8 0
Hedone · Kaoeiri
Params8.03B
Context128K
Smallest8.5 GB
Tool use
ST
MN 12B Starcannon v2
Starcannon · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
QW
IAAR Shanghai xFinder Qwen1505
Qwen · tensorblock
Params620M
Context32K
Smallest0.3 GB
GGUF
GE
GemmaTR WikiQA 4bit
Gemma · cenkersisman
Params27.2B
Context8K
Smallest16.6 GB
GGUF
PI
Pit_Sft_002_Merged
Pit · EryriLabs
Params20.9B
Context128K
Smallest22.3 GB
RoleplayTool use
AN
AnFeng_v3.1 Avocet
Anfeng · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
ME
megastudyedu M SOLAR 10.7B v1.3
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Smallest4.0 GB
GGUF
GO
GOIDA-0.5B
Goida · sizzlebop
Params494M
Context32K
Smallest0.5 GB
Tool use
AN
AnFeng_v3_Avocet
Anfeng · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
AK
Akshar Nano
Akshar · shreyaschavan11
Params1.24B
Context128K
Smallest1.3 GB
GGUF
TI
Tiny RAG
Tiny · TroyDoesAI
Params1.1B
Context2K
Smallest2.2 GB
GGUF
MI
Zlatorog 12B Instruct Beta
Mistral · zidsi
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
SO
M SOLAR 10.7B v1.3
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AG
Aguie v0.1
Aguie · mradermacher
Params13.3B
Context2K
Q4_K_M8.0 GB
GGUF
HE
MS Hempantheonsel Mull v5x1.8RP Cydonia vXXX 24B 12 Q4 K M
Hempantheonsel · Kaoeiri
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
RI
trrapi 16b
Rizla · rizla
Params18.8B
Context32K
Smallest13.5 GB
GGUF
JS
JSL MedLlama 3 8B v2.0 Q8 0
Jsl · JohnnyTriNguyen
Params8.03B
Context8K
Smallest8.5 GB
GGUF
BL
BlackSheep Pi Base
Blacksheep · mradermacher
Params3.14B
Context16K
Q4_K_M1.9 GB
GGUF

Keep browsing