GGUF models: cc-by-nc-4.0 license

5153 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 235B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
Tool use
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
FI
Fibo 2.0 GGUFs
Fibo · realrebelai
Params8.23B
Context—
Smallest6.6 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
GGUF
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RW
rwitz_go-bruins-v2
Rwitz · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
JI
Jina Embeddings v5 Text Small Clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
ST
L3 8B Stheno v3.2
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · NeverSleep
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · OuteAI
Params500M
Context32K
Q4_K_M0.4 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · Salesforce
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
MI
Mixtral_7Bx2_MoE_13B
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · bartowski
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
KU
sanjiwatsuki_kunoichi-7b
Kunoichi · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
StartLux Decision v1 0.8B Q8 0
Startlux · startlux-models
Params752M
Context256K
Smallest0.8 GB
GGUF
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
NE
Nethena 13B
Nethena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JI
Jina Reranker v3.5
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
Embedding
NO
Nous Hermes 13B Code
Nous · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CodingTool use
MX
MXLewd L2 20B i1
Mxlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing