GGUF models: agpl-3.0 license
275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.
MA
Mangolian
Mangolian · jeiku
Params4.51B
Context128K
Smallest2.6 GB
CH
ChemDFM 13B v1.0
Chemdfm · LouisMclean
Params13.1B
Context2K
Smallest26.2 GB
QW
Ogrenim Arisi
Qwen · BeeLang
Params8.19B
Context32K
Q4_K_M5.0 GB
JU
Juno 3b
Juno · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
DA
Darkens 8B Q5 K M
Darkens · jaspionjader
Params8.41B
Context16K
Smallest6.0 GB
KG
Kgr 600m 2511 It 709
Kgr · marcuscedricridia
Params596M
Context40K
Q4_K_M0.4 GB
MA
MaziyarPanahi Ultra WizardLM 120B v0.1
Maziyarpanahi · RichardErkhov
Params120B
Context4K
Smallest44.2 GB
UL
Ultra Smaug 125B v0.1
Ultra · mradermacher
Params125B
Context32K
Smallest46.3 GB
LO
Lotus Fixed
Lotus · Ryex
Params11.8B
Context2K
Q4_K_M7.6 GB
SM
Mateiai Gguf5
SmolLM · devmatei
Params362M
Context8K
Q4_K_M0.3 GB
EJ
Ejos
Ejos · Bunyaaminn
Params8.03B
Context128K
Smallest4.9 GB
CH
chart metadata
Chart · clnnn
Params3.82B
Context4K
Q4_K_M2.3 GB
MI
coder
Mistral · Raiff1982
Params—
Context1K
Smallest0.0 GB
MA
Mark Engineer V2 8B
Mark · miceworks
Params2.75B
Context8K
Smallest5.5 GB