GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SI
Silicon-Alice-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
TE
TextTopic 30B MOE Flash
Texttopic · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
SL
SLM SQL Base 1B
Slm · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
JU
JJ 1 2B
Jurinai · JurinAI
Params1.88B
Context256K
Smallest2.0 GB
ReasoningTool useVision
CO
C4Ai Command R 08 2024
Command R · RichardErkhov
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
CA
CatunaLaserPi i1
Catunalaserpi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
fireblossom 32K 7B
Fireblossom · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Skadi Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheSpice 7b v0.1.1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
BrokenKeyboard
Brokenkeyboard · RichardErkhov
Params7.2B
Context4K
Q4_K_M4.4 GB
GGUF
OP
OpenCAI-8B-V2
Opencai · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MU
Muhammad2003 Myriad 7B Slerp
Muhammad · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
Solus 103B L2
Solus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
ON
ONCA-3.0-12B
Onca · Joesh1
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · xaskasdf
Params104B
Context128K
Smallest39.5 GB
GGUF
MA
maestrale chat v0.2 alpha sft
Maestrale · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
SA
Sao10K Fimbulvetr 11B v2
Sao · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AU
Augmentasanguis-PDE-8x7B
Augmentasanguis · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MA
matsuolab weblab 10b instruction sft
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
GGUF
LL
badger mu llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
OpenOrca Zephyr 7B
Openorca · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 Coder 7B 20260219
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
AS
DreadPoor/Aspire-8B-model_stock
Aspire · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
maldv winter garden 7b alpha
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
Jina Embeddings v3
Jina · gaianet
Params558M
Context8K
Q4_K_M0.4 GB
CodingEmbedding

Keep browsing