GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
AI
Airoboros 13b Gpt4 1.3
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LL
llama-3-fantasy-writer-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 12B GGUF IQ Imatrix
Lumimaid · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
FA
Faust 1
Faust · tabularisai
Params1.61B
Context40K
Smallest1.7 GB
NE
Nete 13B
Nete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SH
Sharp Fin v2 9b
Sharp · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
CO
CoCo Decision 4B
Coco · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
AR
Aryabhata 1.0 i1
Aryabhata · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma4 Tamil E4B It
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
RE
ReMM SLERP L2 13B i1
Remm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KU
Kunoichi DPO v2 7B GGUF Imatrix
Kunoichi · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
AY
aya 23 8B
Aya · QuantFactory
Params8B
Context4194304K
Q4_K_M5.1 GB
UL
UltraMerge 7B
Ultramerge · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
jina embeddings v5 omni small classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
ML
MLewd ReMM L2 Chat 20B
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MI
Mistral 7B Merge 14 v0.1
Mistral · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
DM
dmis lab meerkat 7b v1.0
Dmis · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOVLish-Devil-8B-L3
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
JI
jina v5 nano
Jina · cstr
Params212M
Context8K
Smallest0.2 GB
ST
L3 8B Stheno v3.3 32K
Stheno · QuantFactory
Params8.03B
Context32K
Q4_K_M4.9 GB
OM
OmniBeagleMBX v3 7B i1
Omnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AN
Anime Speech Japanese Captioner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
XW
Xwin MLewd 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
StartLux Decision v1 2B
Startlux · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
SA
saishf Top Western Maid 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LU
Lumimaid v0.2 8B Heretic
Lumimaid · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ME
Merge-Mayhem-L3-V2
Merge · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
TI
Tiny Cowboy 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB