GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
KU
Kuno Lake 7B
Kuno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ML
mlabonne AlphaMonarch 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HO
HOTHUN Stheno 3.2 v1.3
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
EmbeddedLLM Mistral 7B Merge 14 v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
ON
ONeil-model_stock-8B
Oneil · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
Novus-7b-tr_v1
Daredevil · helizac
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PR
Proctora
Proctora · Artefact2
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Miqu PlayMaid 70B v0.1 i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
GU
Guru 32B
Guru · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MI
OmniLing V1 12b experimental
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
NyakuraV2 34B Yi Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
UN
Unholy v1.1 13B i1
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ML
MLewd v2.4 13B
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
Kuro Lotus 10.7B
Kuro · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
HE
heretic_xLAM 2 1b Fc R
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
LDCC LDCC Instruct Llama 2 ko 13B v1.7
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
AR
Arsenic Shahrazad 12B v4.4.2 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
TH
Thespis CurtainCall 7b v0.3
Thespis · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b Fc R
Xlam · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
PL
PLLuM 8x7B Nc Chat
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 11B OmniMix
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MA
E1 Math 1.5B
Math · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
SA
Sao10K L3 8B Niitama v1
Sao · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Coomand R 35B v1
Coomand · BeaverLegacy
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Llamix2 MLewd 4x13B i1
Llamix · mradermacher
Params38.5B
Context32K
Q4_K_M23.3 GB
GGUF
LL
Llama xLAM 2 70b Fc R
Llama · DevQuasar-13
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-2fail-128total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Airoboros 13b Gpt4 1.2
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
KE
musicgen-keygen-gary-v2-large-12-3.3B-v1.0-F16
Keygen · thepatch
Params58M
Context—
Q4_K_M2.2 GB
GGUF
LL
Llama 3 Luminurse v0.1 OAS 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing