GGUF models: cc-by-nc-nd-4.0 license
334 GGUF models listed under the cc-by-nc-nd-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 88M to 70.6B parameters. The longest trained context is 1024K tokens.
KE
Keiana L3 Test6.2 8B 18
Keiana · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
Bald Eagle 7B
Bald · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AU
AuriAetherwiing MN 12B Starcannon v2
Auriaetherwiing · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
KE
Keiana-L3-Test5.75-8B-13.5
Keiana · Kaoeiri
Params8.03B
Context8K
Smallest6.6 GB
AG
Aguie chat proto
Aguie · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
AK
Akshar Nano V2
Akshar · shreyaschavan11
Params1.24B
Context128K
Smallest1.3 GB
VE
Velara
Velara · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
DP
ME Dpo 7B v1.1
Dpo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DP
ME Dpo 7B v1.0
Dpo · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DO
Dolus 14b Mini Q5 K M
Dolus · Jianping746
Params11.5B
Context8K
Smallest8.2 GB
QW
kagentlms qwen 7b mat
Qwen · kwaikeg
Params7.72B
Context8K
Smallest4.5 GB
TH
TheBuddha
Thebuddha · teyler
Params3.21B
Context128K
Smallest6.4 GB
HE
Hedone L3.1 8B v1.1 Q8 0
Hedone · Kaoeiri
Params8.03B
Context128K
Smallest8.5 GB
ST
MN 12B Starcannon v2
Starcannon · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
QW
IAAR Shanghai xFinder Qwen1505
Qwen · tensorblock
Params620M
Context32K
Smallest0.3 GB
GE
GemmaTR WikiQA 4bit
Gemma · cenkersisman
Params27.2B
Context8K
Smallest16.6 GB
PI
Pit_Sft_002_Merged
Pit · EryriLabs
Params20.9B
Context128K
Smallest22.3 GB
AN
AnFeng_v3.1 Avocet
Anfeng · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
ME
megastudyedu M SOLAR 10.7B v1.3
Megastudyedu · RichardErkhov
Params10.7B
Context4K
Smallest4.0 GB
GO
GOIDA-0.5B
Goida · sizzlebop
Params494M
Context32K
Smallest0.5 GB
AN
AnFeng_v3_Avocet
Anfeng · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
AK
Akshar Nano
Akshar · shreyaschavan11
Params1.24B
Context128K
Smallest1.3 GB
TI
Tiny RAG
Tiny · TroyDoesAI
Params1.1B
Context2K
Smallest2.2 GB
MI
Zlatorog 12B Instruct Beta
Mistral · zidsi
Params12.2B
Context128K
Q4_K_M7.5 GB
SO
M SOLAR 10.7B v1.3
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
AG
Aguie v0.1
Aguie · mradermacher
Params13.3B
Context2K
Q4_K_M8.0 GB
HE
MS Hempantheonsel Mull v5x1.8RP Cydonia vXXX 24B 12 Q4 K M
Hempantheonsel · Kaoeiri
Params23.6B
Context32K
Q4_K_M14.3 GB
RI
trrapi 16b
Rizla · rizla
Params18.8B
Context32K
Smallest13.5 GB
JS
JSL MedLlama 3 8B v2.0 Q8 0
Jsl · JohnnyTriNguyen
Params8.03B
Context8K
Smallest8.5 GB
BL
BlackSheep Pi Base
Blacksheep · mradermacher
Params3.14B
Context16K
Q4_K_M1.9 GB