GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
BE
BerrySauce L2 13B
Berrysauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OC
NexaAIDev.octopus planning
Octopus · DevQuasar-8
Params3.82B
Context128K
Q4_K_M2.4 GB
LI
Lila-103B-L2
Lila · mradermacher
Params103B
Context4K
Smallest21.7 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
CohereLabs.c4ai Command R Plus
Command R · DevQuasar
Params104B
Context128K
Q4_K_M62.8 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Nemotron-Research-Reasoning-Qwen-1.5B
Qwen · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
HE
Hemmingway 1 Heretic
Hemmingway · darrellbest
Params27.3B
Context256K
Q4_K_M16.8 GB
OP
weyaxi_openorca-zephyr-7b
Openorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 33b Gpt4
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoMistral 7b Instruct 2025 04 23
Romistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
RE
reader lm 0.5b
Reader · MaziyarPanahi
Params494M
Context250K
Q4_K_M0.4 GB
CO
command a reasoning 08 2025 i1
Command · mradermacher
Params111B
Context488K
Smallest0.0 GB
QW
Qwen2 7B Instruct
Qwen · joongi007
Params7.61B
Context32K
Q4_K_M4.7 GB
EL
electric sheep 7b alpha i1
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
Nyxene 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
RO
RoLlama3-8b-Instruct
Rollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceMoonshineRP 7b
Icemoonshinerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Refueled
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
ChatWaifu_12B_v2.0
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
L3.1 8b TheSpice V0.9 Base v2 i1
Thespice · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GP
FlashTopic Gpt Oss 20b Qat 0924 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
SE
seyf1elislam WestKunai Hermes 10.7b test
Seyf · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
NE
Nemo 12b TheAnswer v0.1 E2 i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
HE
heretic_xLAM 2 1b Fc R
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · VongolaChouko
Params12.2B
Context1000K
Q4_K_M7.5 GB
QE
Qevi 2B
Qevi · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
OU
Oumuamua-7b-RP
Oumuamua · Aratako
Params7.33B
Context32K
Q4_K_M4.4 GB