GGUF models: agpl-3.0 license
275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.
MA
Mark-Engineer-V3-1.5B
Mark · miceworks
Params1.52B
Context32K
Smallest0.9 GB
QW
Qwable v2
Qwable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
BA
Baldur 8B i1
Baldur · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CR
Crunchy onion
Crunchy · Epiculous
Params46.7B
Context32K
Q4_K_M28.4 GB
CA
CalliopeDS L2 13B
Calliopeds · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MA
Mark-General-V3-1.5B
Mark · miceworks
Params1.52B
Context32K
Smallest0.9 GB
MA
Mark-V3-1.1B
Mark · miceworks
Params1.22B
Context32K
Smallest0.7 GB
OP
OpenElla NovelWriter Requiem Ascended
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen35B Agent R2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Abliterix EGA Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CH
ChemDFM v1.0 13B
Chemdfm · mradermacher
Params13.1B
Context2K
Q4_K_M7.9 GB
EL
ElaNore3 4B_ADJUSTED_DPO Merged
Elanore · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
CO
Control 8B i1
Control · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen 7B Chat Cantonese
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
KI
Agents A1 4B kimi Preview
Kimi · hotdogs
Params4.21B
Context256K
Smallest2.6 GB
PR
Prose Rewriter 1.7b v2.3
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
MI
ICONOCLAST Mistral-7B-Instruct-v0.3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Darkens 8B i1
Darkens · mradermacher
Params8.41B
Context16K
Q4_K_M5.1 GB
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
CA
CalliopeDS L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MR
MrgrtV1 8B Merged
Mrgrtv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
ChemDFM v2.0 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen35B Agent R2 Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OP
OpenElla NovelWriter 8B Merged
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
OpenElla NovelWriter Charol
Openella · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CH
Chronolima Airo Grad L2 13B
Chronolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TO
Tor 8B i1
Tor · mradermacher
Params8.41B
Context16K
Q4_K_M5.1 GB
MI
Mika-7B
Mika · Epiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WizardLM Math 70B TIES v0.1 i1
Wizardlm · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PR
Prose Rewriter 4b v2.4
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB