GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CH
ChatWaifu_32B_reasoning
Chatwaifu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CO
c4ai command r v01 jacobian lens
Command R · gghfez
Params2.62B
Context—
Smallest5.2 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · mradermacher
Params8.04B
Context4192K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
AY
Aya Expanse 32b
Aya · lmstudio-community
Params32.3B
Context8K
Q4_K_M19.8 GB
AN
Antares 11b v1
Antares · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LD
LDCC SOLAR gugutypus 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
MI
Chronos Gold 12B 1.0
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
HA
Hammer2.1 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · mradermacher
Params2.09B
Context8K
Q4_K_M1.4 GB
RO
Rokot Omr 2b
Rokot · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
MI
mii llm maestrale chat v0.2 alpha sft
Mii · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
OmniBeagleSquaredMBX v3 7B i1
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AC
AceMath 7B Instruct
Acemath · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
CO
command a 03 2025 uncut i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
BE
Beyonder 4x7B v3
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
JU
JJ-1-0.8B
Jurinai · JurinAI
Params752M
Context256K
Smallest0.8 GB
PL
PLLuM 12B nc instruct
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3 8B Instruct ortho baukit i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen 14b Chat Yarn 32k
Qwen · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
ME
CLaMP3 SAAS
Mert · gorse-io
Params—
Context—
Q4_K_M0.6 GB
CH
Chipcraftx Rtlgen 7b
Chipcraftx · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
HA
Hala 350M
Hala · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
CO
C4Ai Command R 08 2024
Command R · lmstudio-community
Params32.3B
Context128K
Q4_K_M19.8 GB
EM
Monarch 7B
Emertonmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Tiny Aya Global
Tiny · professorf
Params3.35B
Context488K
Q4_K_M2.1 GB
AY
Aya Expanse 8b Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
LO
Loyal Toppy Bruins Maid 7B DARE
Loyal · SanjiWatsuki
Params7.24B
Context32K
Smallest3.1 GB
LL
Llama 3 Unholy 8B e4 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB