GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
SI
Silicon-Alice-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
TE
TextTopic 30B MOE Flash
Texttopic · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
SL
SLM SQL Base 1B
Slm · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
JU
JJ 1 2B
Jurinai · JurinAI
Params1.88B
Context256K
Smallest2.0 GB
CO
C4Ai Command R 08 2024
Command R · RichardErkhov
Params32.3B
Context128K
Q4_K_M19.8 GB
CA
CatunaLaserPi i1
Catunalaserpi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
fireblossom 32K 7B
Fireblossom · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Skadi Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheSpice 7b v0.1.1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
BrokenKeyboard
Brokenkeyboard · RichardErkhov
Params7.2B
Context4K
Q4_K_M4.4 GB
OP
OpenCAI-8B-V2
Opencai · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MU
Muhammad2003 Myriad 7B Slerp
Muhammad · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
Solus 103B L2
Solus · TheBloke
Params103B
Context4K
Smallest43.5 GB
ON
ONCA-3.0-12B
Onca · Joesh1
Params11.9B
Context256K
Q4_K_M7.4 GB
CO
C4Ai Command R Plus 08 2024
Command R · xaskasdf
Params104B
Context128K
Smallest39.5 GB
MA
maestrale chat v0.2 alpha sft
Maestrale · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
SA
Sao10K Fimbulvetr 11B v2
Sao · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
C4Ai Command R 08 2024
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AU
Augmentasanguis-PDE-8x7B
Augmentasanguis · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MA
matsuolab weblab 10b instruction sft
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
LL
badger mu llama 3 8b
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
OpenOrca Zephyr 7B
Openorca · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron 8B UltraLong 2M Instruct
Llama · mradermacher
Params8.04B
Context2096K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 7B 20260219
Qwen · igarin
Params7.62B
Context32K
Q4_K_M4.7 GB
AS
DreadPoor/Aspire-8B-model_stock
Aspire · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
maldv winter garden 7b alpha
Maldv · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
Jina Embeddings v3
Jina · gaianet
Params558M
Context8K
Q4_K_M0.4 GB