GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
MI
NeuraLake m7 v2 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B HerO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
MiMo V2.6 Flash MOPD jacobian lens
Mimo · gghfez
Params789M
Context—
Smallest1.6 GB
EU
langlm
Eurollm · AnthonyFC
Params1.29B
Context4K
Smallest0.8 GB
BY
Byungchae/k2s3_test_0000
Byungchae · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
grimjim/llama-3-Nephilim-v2.1-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Lyra Gutenberg mistral nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
ChatWaifu_v1.0
Chatwaifu · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
MI
Mistral 7B claude chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceDrinkNameGoesHereV0RP 7b Model Stock i1
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
royallab/ZephRP-m7b
Zephrp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
m a p.YuE s1 7B anneal en cot
Yue · DevQuasar-4
Params6.22B
Context16K
Q4_K_M3.8 GB
BR
Brunhilde 13b v1
Brunhilde · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
JI
Jina Embeddings v5 Text Small Clustering
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
IN
Ina v11.1
Ina · QuixiAI
Params70.6B
Context128K
Q4_K_M42.5 GB
RO
RoLlama3 8b Instruct 2024 10 09
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
RH
L3 Rhaenys 2x8B i1
Rhaenys · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
IC
IceDrinkNameGoesHereRP 7b
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
cohere aya
Cohere · tripolskypetr
Params35B
Context8K
Q4_K_M5.1 GB
MI
Herry443/Mistral-7B-KNUT-ref-ALL
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
gemma 7b openhermes
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
MA
grimjim_Magrathic 12B
Magrathic · grimjim
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Eagle2-1B
Qwen · Mungert
Params630M
Context32K
Smallest0.4 GB
XL
xLAM 7b Fc R
Xlam · gaianet
Params6.91B
Context4K
Q4_K_M4.2 GB
PA
paulml DPOB INMTOB 7B
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
HOTHUN Stheno 3.2 v1.2
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CR
Creative Writer v0.1 Alfa 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
BI
BigL 7B
Bigl · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB