GGUF models: agpl-3.0 license

275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Prose Rewriter 4b v2.2
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
MI
Tor 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
LU
XT Luna 1B
Luna · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
MI
XT Luna 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
CH
ChemDFM R 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MA
mark-engineer-1.5b
Mark · miceworks
Params1.5B
Context4K
Smallest0.8 GB
Coding
PR
Prose Rewriter 1.7b v2.4
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
GGUF
MA
Mark Engineer 302M
Mark · miceworks
Params251M
Context4K
Smallest0.1 GB
GGUF
MA
mark-general-1.5b
Mark · miceworks
Params1.5B
Context4K
Smallest0.8 GB
Reasoning
MI
Michel 13B
Michel · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PR
Prose Rewriter 4b v1.6
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
MA
Mark-General-V3-8B
Mark · miceworks
Params8.17B
Context32K
Smallest4.6 GB
GGUF
PR
Prose Rewriter 4b v2.3
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.6 35B A3B Abliterix EGA abliterated
Qwen · jenerallee78
Params34.7B
Context256K
Smallest25.0 GB
ReasoningTool useVision
CH
ChemDFM R 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Qwen3.6 35B A3B Abliterix EGA Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
PY
pygmalion 1.3b i1
Pygmalion · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
QW
Qwen 7B Chat Cantonese
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
QW
Prose Rewriter 4b v1.2
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
MA
Mark VL 2.2B
Mark · miceworks
Params2.17B
Context256K
Q4_K_M2.5 GB
ReasoningVision
QW
DecisionNode Edge 0.9.1
Qwen · bynn-intelligence-com
Params1.88B
Context256K
Smallest2.0 GB
Vision
QW
qwen27b abliterated Fable MTP
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
OP
OpenElla NovelWriter Requiem Ascended
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
CO
Control 8B V1.1
Control · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
ICONOCLAST Llama-3.1-8B-Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
qwen35b a3b fable sft abliterated
Qwen · hotdogs
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LL
Baldur 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
PU
PULSE 7bv5 i1
Pulse · mradermacher
Params8.1B
Context2K
Q4_K_M5.3 GB
GGUF
MI
Mika 7B i1
Mika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
PU
PULSE 20bv5
Pulse · mradermacher
Params20.1B
Context16K
Q4_K_M12.2 GB
GGUF

Keep browsing