GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama 3 Nephilim v1 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama 3 Nephilim v3 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LE
Lewd Sydney 20B
Lewd · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
WO
WoonaAI OmniLing V1 8b experimental
Woonaai · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FO
MN 12B FoxFrame Miyuri
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TE
Test0 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
LaserPipe 7B SLERP
Mistral · BryanSwk
Params7.24B
Context32K
Smallest4.4 GB
GGUF
VI
VideoMAE
Videomae · SkyContact
Params88M
Context—
Smallest0.1 GB
GGUF
CH
spow12/ChatWaifu_v1.4
Chatwaifu · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
UN
Unholy v1 12L 13B i1
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PS
Psyfighter2 Noromaid ties Capybara 13B
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
PH
phonon 40m pt
Phonon · ldenoue
Params51M
Context—
Smallest0.1 GB
GGUF
LY
MN 12B Lyra v4
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EL
EleMo V2
Elemo · Earlychildhoodeducation
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
KU
Kunokukulemonchini 7b
Kunokukulemonchini · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NB
nbeerbower Lyra4 Gutenberg 12B
Nbeerbower · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
AY
aya-23-35B
Aya · LiteLLMs
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
WE
WestLake_Noromaid_OpenHermes_neural Chat
Westlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OR
saishf/Ortho-SOVL-8B-L3
Ortho · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
Ina v11.1
Ina · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
MI
Minerva
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
GGUF
SA
saishf SOVLish Devil 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
G COOM 9B V0.01
Coom · Quant-Cartel
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PI
Pi3X
oxide-lab
Params1.36B
Context—
Smallest0.8 GB
GGUF
DO
SJ Donald SJ SOLAR 10.7b DPO
Donald · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
TA
tannedbum L3 Nymeria v2 8B
Tannedbum · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
ChatWaifu_v2.0_22B
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
ReasoningRoleplay

Keep browsing