GGUF models: cc-by-nc-4.0 license
5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
FI
Fibo 2.0 GGUFs
Fibo · realrebelai
Params8.23B
Context—
Smallest6.6 GB
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RW
rwitz_go-bruins-v2
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
JI
Jina Embeddings v5 Text Small Clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
ST
L3 8B Stheno v3.2
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 12B
Lumimaid · NeverSleep
Params12.2B
Context1000K
Q4_K_M7.5 GB
OU
OuteTTS 0.2 500M
Outetts · OuteAI
Params500M
Context32K
Q4_K_M0.4 GB
XL
xLAM 2 3b Fc R
Xlam · Salesforce
Params3.09B
Context32K
Q4_K_M1.9 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
Mixtral_7Bx2_MoE_13B
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KU
sanjiwatsuki_kunoichi-7b
Kunoichi · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
StartLux Decision v1 0.8B Q8 0
Startlux · startlux-models
Params752M
Context256K
Smallest0.8 GB
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
NE
Nethena 13B
Nethena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
JI
Jina Reranker v3.5
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
NO
Nous Hermes 13B Code
Nous · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MX
MXLewd L2 20B i1
Mxlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB