GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
SOLAR 10.7B Instruct STOCK_SOLAR Passthrough
Solar · RichardErkhov
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
IN
Instant RP Noodles 12B v1.4
Instant · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
DR
Draig Fach v0.1 i1
Draig · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Cognita Mini 167M
Cognita · mradermacher
Params167M
Context4K
Q4_K_M0.1 GB
GGUF
MA
E1 Math 7B
Math · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
MI
undi95_mistrp-airoboros-7b
Mistrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Merge-Mayhem-L3-V2.1
Merge · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QF
QFFT LIMO 7B
Qfft · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
KU
Kunoichi DPO v2 7B i1
Kunoichi · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CH
CheXOne
Chexone · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
ReasoningVision
CR
Creative Writer Plus 35b Preview 01 2025
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CH
ChatWaifu_12B_v2.0
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MA
Maidphin Kunoichi 7B
Maidphin · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
GGUF
CO
Command R 35b Writer v2
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
AN
Anime Speech Japanese Refiner
Anime · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool use
OU
OuteTTS 0.3 500M
Outetts · second-state
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Llama 3 Lumimaid 70B v0.1 Alt Heretic
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
FI
Fimbulvetr 11B v2 Heretic
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NE
Monarch 7B
Neuralmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemo 12b TheAnswer v0.1 E2
Nemo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Nc Base 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PR
Proctora i1
Proctora · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
LLaMA2-13B-Estopia
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen 2.5 Coder Arctic ExCoT 32B
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
MA
Salesforce.E1 Math 7B
Math · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
XL
xLAM-2-3b-fc-r
Xlam · Mungert
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
AC
AceMath 72B Instruct
Acemath · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
FO
MN 12B FoxFrame Yukina
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
ColdBrew Nemo 12B Arcane Base M
Coldbrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use

Keep browsing