GGUF models: agpl-3.0 license

275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
FE
Fett uccine 7B i1
Fett · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Prose Rewriter 4b v2.2
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Prose Rewriter 4b v2.4
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Qwen35B Agent R2 Abliterated v3
Qwen · hotdogs
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
OP
OpenElla NovelWriter Requiem
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
KR
KrizNore4 E2B v1 Merged
Kriznore · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
PR
Prose Rewriter 4b v2
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Qwable v2
Qwable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
CH
ChemDFM v2.0 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Prose Rewriter 4b v2.5
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
PR
Prose Rewriter 1.7b v2
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
GGUF
MR
MrgrtV2 3B Merged
Mrgrtv · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
RoleplayTool use
QW
DecisionNode Edge Mini 0.9.1
Qwen · bynn-intelligence-com
Params752M
Context256K
Smallest0.8 GB
Vision
QW
Prose Rewriter 4b v2.1
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
CH
ChemDFM 13B v1.0
Chemdfm · RichardErkhov
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
MI
MinerU2.5 2509 1.2B
Mineru · mradermacher
Params494M
Context16K
Q4_K_M0.4 GB
Vision
QW
Prose Rewriter 4b v2.3
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Prose Rewriter 1.7b v2.5
Qwen · chartreuse-verte
Params2.03B
Context32K
Smallest2.2 GB
GGUF
CO
Control 8B V1.1
Control · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
AG
Agents A1 4B Fable Preview
Agents · hotdogs
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
OP
OpenElla NovelWriter 8B Merged
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SO
Solphie 1S Foundation Model
Solphie · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
MinerU2.5 2509 1.2B
Mineru · mradermacher
Params494M
Context16K
Q4_K_M0.4 GB
GGUF
DO
DorsetHeatwaveLLM2
Dorsetheatwavellm · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwable v1
Qwable · jashepp
Params35.5B
Context256K
Smallest20.3 GB
ReasoningTool use
CO
Control 8B V1.1
Control · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
WI
WizardLM Math 70B v0.1 i1
Wizardlm · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Lumo 8B Instruct
Llama · lumolabs-ai
Params8.03B
Context128K
Smallest4.7 GB
Tool use
MR
MrgrtV1 8B Merged
Mrgrtv · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
EL
ElaNore3 4B Merged
Elanore · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningRoleplayTool use

Keep browsing