GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
ChatWaifu_32B_reasoning
Chatwaifu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningRoleplayTool use
CO
c4ai command r v01 jacobian lens
Command R · gghfez
Params2.62B
Context—
Smallest5.2 GB
GGUF
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
Aya Expanse 32b
Aya · lmstudio-community
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AN
Antares 11b v1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
LD
LDCC SOLAR gugutypus 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
MI
Chronos Gold 12B 1.0
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
HA
Hammer2.1 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
RO
Rokot Omr 2b
Rokot · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
MI
mii llm maestrale chat v0.2 alpha sft
Mii · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OM
OmniBeagleSquaredMBX v3 7B i1
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
AceMath 7B Instruct
Acemath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
CO
command a 03 2025 uncut i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
GGUF
BE
Beyonder 4x7B v3
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
JU
JJ-1-0.8B
Jurinai · JurinAI
Params752M
Context256K
Smallest0.8 GB
ReasoningTool useVision
PL
PLLuM 12B nc instruct
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3 8B Instruct ortho baukit i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen 14b Chat Yarn 32k
Qwen · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
ME
CLaMP3 SAAS
Mert · gorse-io
Params—
Context—
Q4_K_M0.6 GB
GGUF
CH
Chipcraftx Rtlgen 7b
Chipcraftx · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
HA
Hala 350M
Hala · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
CO
C4Ai Command R 08 2024
Command R · lmstudio-community
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
EM
Monarch 7B
Emertonmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
Tiny Aya Global
Tiny · professorf
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
AY
Aya Expanse 8b Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LO
Loyal Toppy Bruins Maid 7B DARE
Loyal · SanjiWatsuki
Params7.24B
Context32K
Smallest3.1 GB
GGUF
LL
Llama 3 Unholy 8B e4 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing