GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai Command R 08 2024
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
AG
L3.1 Aglow Vulca v0.1 8B
Aglow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
XL
xLAM 7b Fc R
Xlam · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
DP
DPOB INMTOB 7B i1
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 7b Gpt4 1.4
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AY
Aya23 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AI
Airoboros 13b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BU
Buddy 2B v1
Buddy · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MO
FL 12B MoE 2 Safetensors
Moe · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
MI
OpenMia Indo Mistral 7b v3 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ML
MLewd ReMM L2 Chat 20B i1
Mlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
EC
Echidna-13b-v0.2
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TH
Thanos 8B i1
Thanos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
EM
Emerhyst 13B
Emerhyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TH
Thespis Balanced 7b v1 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChineseGuard 7B
Chineseguard · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
NE
Nemo 12b Humanize SFT v0.2.5 KTO
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
FI
Fimbulvetr-11B-v2
Fimbulvetr · Lewdiculous
Params10.7B
Context4K
Q4_K_M6.5 GB
Roleplay
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
ZO
zomd AISquare Instruct yi ko 6b v0.9.30
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
DU
DukunLM 13B V1.0 Uncensored sharded
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
UL
Ultra Instruct 12B
Ultra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Minerva
Minerva · RichardErkhov
Params2.89B
Context16K
Q4_K_M1.8 GB
GGUF
MY
models--automerger--NeuralsynthesisMyriad-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SaoRPM-2x8B
Saorpm · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
Roleplay
JE
Jellyfish 8B
Jellyfish · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
KoQwen_72B_v5.0
Koqwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
YC
ycros BagelMIsteryTour 8x7B
Ycros · RichardErkhov
Params57.6B
Context32K
Q4_K_M28.4 GB
GGUF
OG
OGNO 7B i1
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing