GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
NeuraLake m7 v2 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B HerO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
MiMo V2.6 Flash MOPD jacobian lens
Mimo · gghfez
Params789M
Context—
Smallest1.6 GB
GGUF
EU
langlm
Eurollm · AnthonyFC
Params1.29B
Context4K
Smallest0.8 GB
GGUF
BY
Byungchae/k2s3_test_0000
Byungchae · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
grimjim/llama-3-Nephilim-v2.1-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Lyra Gutenberg mistral nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CH
ChatWaifu_v1.0
Chatwaifu · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
MI
Mistral 7B claude chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceDrinkNameGoesHereV0RP 7b Model Stock i1
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
royallab/ZephRP-m7b
Zephrp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
m a p.YuE s1 7B anneal en cot
Yue · DevQuasar-4
Params6.22B
Context16K
Q4_K_M3.8 GB
GGUF
BR
Brunhilde 13b v1
Brunhilde · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
JI
Jina Embeddings v5 Text Small Clustering
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
IN
Ina v11.1
Ina · QuixiAI
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
RO
RoLlama3 8b Instruct 2024 10 09
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RH
L3 Rhaenys 2x8B i1
Rhaenys · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Roleplay
IC
IceDrinkNameGoesHereRP 7b
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
cohere aya
Cohere · tripolskypetr
Params35B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Herry443/Mistral-7B-KNUT-ref-ALL
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma 7b openhermes
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
MA
grimjim_Magrathic 12B
Magrathic · grimjim
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
Eagle2-1B
Qwen · Mungert
Params630M
Context32K
Smallest0.4 GB
Tool useVision
XL
xLAM 7b Fc R
Xlam · gaianet
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
PA
paulml DPOB INMTOB 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
HOTHUN Stheno 3.2 v1.2
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CR
Creative Writer v0.1 Alfa 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
BI
BigL 7B
Bigl · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing