GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.3-32K
Stheno · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
NE
NeuralMarcoro14 7B i1
Neuralmarcoro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
meerkat 7b v1.0
Meerkat · mradermacher
Params7.24B
Context32K
Q4_K_M4.8 GB
GGUF
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
XW
Xwin MLewd 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EL
eleusis 7b alpha
Eleusis · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
DR
dragonwar 7b orpo
Dragonwar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayTool use
BI
Bielik 7B Instruct v0.1
Bielik · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b Ungated
Aya · RichardErkhov
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
TO
TowerInstruct 7B v0.2
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3 ChocoLlama 8B instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FL
Flammen Kunoichi 7B
Flammen · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
HE
Hemmingway 1 VL
Hemmingway · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
GGUF
LL
llama-3-Nephilim-v3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
EC
Echidna 13B v0.3
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
AlphaMonarch laser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NE
NeuralDaredevil 7B
Neuraldaredevil · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CatNyanster 34b
Catnyanster · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
Roleplay
IA
Iambe Storyteller 20B
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MA
NeuralMarcoro14 7B
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
NI
L3-8B-Niitama-v1
Niitama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing