GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
Airoboros 13b Gpt4 1.3
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
llama-3-fantasy-writer-8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Lumimaid v0.2 12B GGUF IQ Imatrix
Lumimaid · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
FA
Faust 1
Faust · tabularisai
Params1.61B
Context40K
Smallest1.7 GB
GGUF
NE
Nete 13B
Nete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
Sharp Fin v2 9b
Sharp · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
ST
L3-8B-Stheno-v3.3-32K
Stheno · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
CoCo Decision 4B
Coco · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
AR
Aryabhata 1.0 i1
Aryabhata · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
GE
Gemma4 Tamil E4B It
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
RE
ReMM SLERP L2 13B i1
Remm · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
Kunoichi DPO v2 7B GGUF Imatrix
Kunoichi · Lewdiculous
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AY
aya 23 8B
Aya · QuantFactory
Params8B
Context4194304K
Q4_K_M5.1 GB
GGUF
UL
UltraMerge 7B
Ultramerge · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
jina embeddings v5 omni small classification
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
ML
MLewd ReMM L2 Chat 20B
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MI
Mistral 7B Merge 14 v0.1
Mistral · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DM
dmis lab meerkat 7b v1.0
Dmis · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOVLish-Devil-8B-L3
Sovlish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
JI
jina v5 nano
Jina · cstr
Params212M
Context8K
Smallest0.2 GB
Embedding
ST
L3 8B Stheno v3.3 32K
Stheno · QuantFactory
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
OM
OmniBeagleMBX v3 7B i1
Omnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AN
Anime Speech Japanese Captioner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
XW
Xwin MLewd 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
StartLux Decision v1 2B
Startlux · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
SA
saishf Top Western Maid 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
Lumimaid v0.2 8B Heretic
Lumimaid · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
ME
Merge-Mayhem-L3-V2
Merge · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
TI
Tiny Cowboy 1.1b v0.1 i1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing