GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Turdus 7B
Neuralmarcoro · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct i1
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
OP
OpenLLM Ro RoMistral 7b Instruct
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Unbabel TowerInstruct 13B v0.1
Unbabel · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
MI
Mistral 7B Instruct v0.1
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Suzume Llama 3 8B Multilingual
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim Llama 3 Oasis v1 OAS 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YU
YuE2 3B
Yue · LattifAI
Params3.63B
Context24K
Smallest0.1 GB
GGUF
NO
Nox Solar 10.7b v4 Kolon All 5 v2.0
Nox · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AY
aya-23-8B
Aya · backyardai
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
PO
Poppy_Porpoise DADA 8B
Poppy · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
MobileLLM 600M
Mobilellm · RichardErkhov
Params640M
Context2K
Q4_K_M0.5 GB
GGUF
SP
Spaetzle v31 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
C4Ai Command R Plus
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
GGUF
SO
SOLAR 10.7B v1.2
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AI
Airoboros 13b
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BA
BagelMIsteryTour v2 8x7B i1
Bagelmisterytour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
K2S3 Mistral 7b v1.43
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
XT
xTower13B
Xtower · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
MedDecider 9B
Meddecider · lion-ai
Params9.2B
Context256K
Smallest0.2 GB
GGUF
LY
MN 12B Lyra v4
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CO
C4Ai Command R7B 12 2024
Command R · mmnga
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
SO
K2S3 SOLAR 11b v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KE
kellemar DPO Orca Distilled 7B SLERP i1
Kellemar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GeoBox R1
Geobox · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool useVision
ME
MetaMath Cybertron
Metamath · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OG
OgnoMonarch 7B
Ognomonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alphacode AI AlphaMist7B slr v4 slow
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing