GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CO
C4Ai Command R 08 2024
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
AG
L3.1 Aglow Vulca v0.1 8B
Aglow · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
XL
xLAM 7b Fc R
Xlam · bartowski
Params6.91B
Context4K
Q4_K_M4.2 GB
DP
DPOB INMTOB 7B i1
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 7b Gpt4 1.4
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
AY
Aya23 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
AI
Airoboros 13b Gpt4 1.4.1 Qlora
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
BU
Buddy 2B v1
Buddy · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
MO
FL 12B MoE 2 Safetensors
Moe · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
MI
OpenMia Indo Mistral 7b v3 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ML
MLewd ReMM L2 Chat 20B i1
Mlewd · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
EC
Echidna-13b-v0.2
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
TH
Thanos 8B i1
Thanos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
EM
Emerhyst 13B
Emerhyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TH
Thespis Balanced 7b v1 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
ChineseGuard 7B
Chineseguard · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
C4Ai Command R7B 12 2024
Command R · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
NE
Nemo 12b Humanize SFT v0.2.5 KTO
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
FI
Fimbulvetr-11B-v2
Fimbulvetr · Lewdiculous
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
ZO
zomd AISquare Instruct yi ko 6b v0.9.30
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
DU
DukunLM 13B V1.0 Uncensored sharded
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
UL
Ultra Instruct 12B
Ultra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Minerva
Minerva · RichardErkhov
Params2.89B
Context16K
Q4_K_M1.8 GB
MY
models--automerger--NeuralsynthesisMyriad-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SaoRPM-2x8B
Saorpm · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
JE
Jellyfish 8B
Jellyfish · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
KO
KoQwen_72B_v5.0
Koqwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
YC
ycros BagelMIsteryTour 8x7B
Ycros · RichardErkhov
Params57.6B
Context32K
Q4_K_M28.4 GB
OG
OGNO 7B i1
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB