GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QU
quantumaikr_quantum-dpo-v0.1
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
ProcObject Qwen3 VL 4B
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
SY
Synatra 7B v0.3 RP
Synatra · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
JJ
JJ 1 2B
mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
HA
L3.1 70B Hanami X1
Hanami · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
XL
xLAM 1b Fc R
Xlam · gaianet
Params1.35B
Context16K
Q4_K_M0.9 GB
SH
Sharp Fin v2 4b
Sharp · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
AM
U Amethyst 20B
Amethyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
HO
HOTHUN Stheno 3.2 v1.4
Hothun · Mykee
Params8.03B
Context8K
Q4_K_M4.9 GB
XL
xLAM 7b Fc R
Xlam · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
TO
Tower 7b EAX i1
Tower · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
EM
Emerhyst 20B
Emerhyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
AI
Airoboros Gpt 3.5 Turbo 100k 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Lyra Gutenberg mistral nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Noromaid-v0.1-mixtral-8x7b
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
VE
MN 12B Vespa x1
Vespa · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
PS
PsyMedRP v1 20B
Psymedrp · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
HA
Harmonia 20B i1
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
QU
quds-v4-fa-f16
Quds · cstr
Params114M
Context—
Smallest0.1 GB
CH
L3-8B-Chara-v1-Alpha
Chara · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Uncensored
Qwen · Moranyunchen
Params4.21B
Context256K
Smallest2.3 GB
WI
WinterGoddess 1.4x 70B L2
Wintergoddess · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
IC
IceDrinkNameNotFoundRP 7b Model_Stock
Icedrinknamenotfoundrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-xLAM-2-8b-fc-r
Llama · Mungert
Params8.03B
Context128K
Q4_K_M5.0 GB
KU
kunoichi squared model stock 7B i1
Kunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Neural-SOVLish-Devil-8B-L3
Neural · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
OC
octo-planner-2b
Octo · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
c4ai-command-r-plus
Command R · qwp4w3hyb
Params104B
Context128K
Q4_K_M62.8 GB