GGUF models: agpl-3.0 license
275 GGUF models listed under the agpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 754B parameters. The longest trained context is 256K tokens.
PR
Prose Rewriter 4b v2.2
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
MI
Tor 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
LU
XT Luna 1B
Luna · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
MI
XT Luna 1B
MiniCPM · tinyopsec
Params1.08B
Context128K
Q4_K_M0.7 GB
CH
ChemDFM R 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MA
mark-engineer-1.5b
Mark · miceworks
Params1.5B
Context4K
Smallest0.8 GB
PR
Prose Rewriter 1.7b v2.4
Prose · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
MA
Mark Engineer 302M
Mark · miceworks
Params251M
Context4K
Smallest0.1 GB
MA
mark-general-1.5b
Mark · miceworks
Params1.5B
Context4K
Smallest0.8 GB
MI
Michel 13B
Michel · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PR
Prose Rewriter 4b v1.6
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
MA
Mark-General-V3-8B
Mark · miceworks
Params8.17B
Context32K
Smallest4.6 GB
PR
Prose Rewriter 4b v2.3
Prose · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
QW
Qwen3.6 35B A3B Abliterix EGA abliterated
Qwen · jenerallee78
Params34.7B
Context256K
Smallest25.0 GB
CH
ChemDFM R 14B
Chemdfm · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.6 35B A3B Abliterix EGA Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
PY
pygmalion 1.3b i1
Pygmalion · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
Qwen 7B Chat Cantonese
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.9 GB
QW
Prose Rewriter 4b v1.2
Qwen · chartreuse-verte
Params4.41B
Context32K
Q4_K_M2.7 GB
MA
Mark VL 2.2B
Mark · miceworks
Params2.17B
Context256K
Q4_K_M2.5 GB
QW
DecisionNode Edge 0.9.1
Qwen · bynn-intelligence-com
Params1.88B
Context256K
Smallest2.0 GB
QW
qwen27b abliterated Fable MTP
Qwen · hotdogs
Params27.3B
Context256K
Q4_K_M16.8 GB
OP
OpenElla NovelWriter Requiem Ascended
Openella · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
Control 8B V1.1
Control · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ICONOCLAST Llama-3.1-8B-Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
qwen35b a3b fable sft abliterated
Qwen · hotdogs
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Baldur 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
PU
PULSE 7bv5 i1
Pulse · mradermacher
Params8.1B
Context2K
Q4_K_M5.3 GB
MI
Mika 7B i1
Mika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PU
PULSE 20bv5
Pulse · mradermacher
Params20.1B
Context16K
Q4_K_M12.2 GB