GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
llama 3 Nephilim v1 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 3 Nephilim v3 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
LE
Lewd Sydney 20B
Lewd · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
WO
WoonaAI OmniLing V1 8b experimental
Woonaai · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
FO
MN 12B FoxFrame Miyuri
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TE
Test0 SLIDE GGUF IQ Imatrix
Test · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
LaserPipe 7B SLERP
Mistral · BryanSwk
Params7.24B
Context32K
Smallest4.4 GB
VI
VideoMAE
Videomae · SkyContact
Params88M
Context—
Smallest0.1 GB
CH
spow12/ChatWaifu_v1.4
Chatwaifu · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
UN
Unholy v1 12L 13B i1
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PS
Psyfighter2 Noromaid ties Capybara 13B
Psyfighter · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
PH
phonon 40m pt
Phonon · ldenoue
Params51M
Context—
Smallest0.1 GB
LY
MN 12B Lyra v4
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EL
EleMo V2
Elemo · Earlychildhoodeducation
Params26.9B
Context256K
Q4_K_M16.5 GB
KU
Kunokukulemonchini 7b
Kunokukulemonchini · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NB
nbeerbower Lyra4 Gutenberg 12B
Nbeerbower · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
AY
aya-23-35B
Aya · LiteLLMs
Params35B
Context8K
Q4_K_M21.5 GB
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
WE
WestLake_Noromaid_OpenHermes_neural Chat
Westlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
saishf/Ortho-SOVL-8B-L3
Ortho · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
Ina v11.1
Ina · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Minerva
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
SA
saishf SOVLish Devil 8B L3
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
G COOM 9B V0.01
Coom · Quant-Cartel
Params9.24B
Context8K
Q4_K_M5.8 GB
PI
Pi3X
oxide-lab
Params1.36B
Context—
Smallest0.8 GB
DO
SJ Donald SJ SOLAR 10.7b DPO
Donald · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
TA
tannedbum L3 Nymeria v2 8B
Tannedbum · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
ChatWaifu_v2.0_22B
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB