GGUF models: agpl-3.0 license
275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.
FE
Fett uccine 7B i1
Fett · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Prose Rewriter 4b v2.2
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
Prose Rewriter 4b v2.4
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
Qwen35B Agent R2 Abliterated v3
Qwen · hotdogs
Params34.7B
Context256K
Q4_K_M21.2 GB
OP
OpenElla NovelWriter Requiem
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
KR
KrizNore4 E2B v1 Merged
Kriznore · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
PR
Prose Rewriter 4b v2
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
Qwable v2
Qwable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CH
ChemDFM v2.0 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Prose Rewriter 4b v2.5
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
PR
Prose Rewriter 1.7b v2
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
MR
MrgrtV2 3B Merged
Mrgrtv · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
DecisionNode Edge Mini 0.9.1
Qwen · bynn-intelligence-com
Params752M
Context256K
Smallest0.8 GB
QW
Prose Rewriter 4b v2.1
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
CH
ChemDFM 13B v1.0
Chemdfm · RichardErkhov
Params13.1B
Context2K
Q4_K_M7.9 GB
MI
MinerU2.5 2509 1.2B
Mineru · mradermacher
Params494M
Context16K
Q4_K_M0.4 GB
QW
Prose Rewriter 4b v2.3
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
Prose Rewriter 1.7b v2.5
Qwen · chartreuse-verte
Params2.03B
Context32K
Smallest2.2 GB
CO
Control 8B V1.1
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
AG
Agents A1 4B Fable Preview
Agents · hotdogs
Params4.21B
Context256K
Q4_K_M2.7 GB
OP
OpenElla NovelWriter 8B Merged
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
Solphie 1S Foundation Model
Solphie · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MinerU2.5 2509 1.2B
Mineru · mradermacher
Params494M
Context16K
Q4_K_M0.4 GB
DO
DorsetHeatwaveLLM2
Dorsetheatwavellm · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
QW
Qwable v1
Qwable · jashepp
Params35.5B
Context256K
Smallest20.3 GB
CO
Control 8B V1.1
Control · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
WI
WizardLM Math 70B v0.1 i1
Wizardlm · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Lumo 8B Instruct
Llama · lumolabs-ai
Params8.03B
Context128K
Smallest4.7 GB
MR
MrgrtV1 8B Merged
Mrgrtv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EL
ElaNore3 4B Merged
Elanore · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB