GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
SL
SLM SQL 0.6B
Slm · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
XL
xLAM 8x7b R
Xlam · lmstudio-community
Params46.7B
Context32K
Q4_K_M28.4 GB
CO
C4Ai Command R 08 2024
Command R · gaianet
Params32.3B
Context128K
Q4_K_M19.8 GB
ML
MLewdBoros L2 13B SuperCOT
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KU
kukulemon 7B
Kukulemon · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheSpice 7b FT v0.3.1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
mlabonne/AlphaMonarch-7B
Alphamonarch · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
E Star 12B Base
Star · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SO
SOLAR math 2x10.7b v0.2 i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
YI
Yi 6B yoruno
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
LA
gguf sharded LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
IT
ITT Yi Ko 6B v1.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
IT
ITT Yi Ko 6B v6.0
Itt · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
LL
maldv/badger-writer-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
finch shorirp
Finch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 65b Gpt4 1.4
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
25
256m i1
mradermacher
Params256M
Context2K
Q4_K_M0.2 GB
BU
Buddy 2B v1
Buddy · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
CA
Cat 8x7B
Cat · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
FR
Frostwind-v2.1-m7
Frostwind · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
tiny aya global strategy agent
Tiny · HatemSaadallah
Params30M
Context—
Smallest0.1 GB
ST
StartLux Decision v1 4B BF16
Startlux · startlux-models
Params4.21B
Context256K
Smallest8.4 GB
SO
SOLAR 10.7B v1.4
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
BT
4BTestRC
Btestrc · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
SE
Seraph 7B
Seraph · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceDrinkNameGoesHereV0RP 7b Model Stock
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
CausalLM RP 34B
Causallm · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
RO
RoMistral 7b Instruct DPO 2024 10 09
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
Omnarch 7B i1
Omnarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Salesforce.E1 Code 14B
Code · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB