GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
BerrySauce L2 13B
Berrysauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OC
NexaAIDev.octopus planning
Octopus · DevQuasar-8
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LI
Lila-103B-L2
Lila · mradermacher
Params103B
Context4K
Smallest21.7 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
CohereLabs.c4ai Command R Plus
Command R · DevQuasar
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
MI
TowerInstruct Mistral 7B v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Nemotron-Research-Reasoning-Qwen-1.5B
Qwen · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
HE
Hemmingway 1 Heretic
Hemmingway · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
OP
weyaxi_openorca-zephyr-7b
Openorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 33b Gpt4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoMistral 7b Instruct 2025 04 23
Romistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Reasoning
RE
reader lm 0.5b
Reader · MaziyarPanahi
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
CO
command a reasoning 08 2025 i1
Command · mradermacher
Params111B
Context488K
Smallest0.0 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · joongi007
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
EL
electric sheep 7b alpha i1
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
Nyxene 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Reasoning
IC
IceMoonshineRP 7b
Icemoonshinerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
ChatWaifu_12B_v2.0
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
TH
L3.1 8b TheSpice V0.9 Base v2 i1
Thespice · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GP
FlashTopic Gpt Oss 20b Qat 0924 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
SE
seyf1elislam WestKunai Hermes 10.7b test
Seyf · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
Tool use
NE
Nemo 12b TheAnswer v0.1 E2 i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
HE
heretic_xLAM 2 1b Fc R
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
ST
Starcannon Unleashed 12B v1.0
Starcannon · VongolaChouko
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QE
Qevi 2B
Qevi · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
OU
Oumuamua-7b-RP
Oumuamua · Aratako
Params7.33B
Context32K
Q4_K_M4.4 GB
Roleplay

Keep browsing