GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SL
SLM SQL 0.6B
Slm · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
XL
xLAM 8x7b R
Xlam · lmstudio-community
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
CO
C4Ai Command R 08 2024
Command R · gaianet
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
ML
MLewdBoros L2 13B SuperCOT
Mlewdboros · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
kukulemon 7B
Kukulemon · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheSpice 7b FT v0.3.1
Thespice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
mlabonne/AlphaMonarch-7B
Alphamonarch · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
E Star 12B Base
Star · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
SO
SOLAR math 2x10.7b v0.2 i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
YI
Yi 6B yoruno
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LA
gguf sharded LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
GGUF
IT
ITT Yi Ko 6B v1.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
IT
ITT Yi Ko 6B v6.0
Itt · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
LL
maldv/badger-writer-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FI
finch shorirp
Finch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 65b Gpt4 1.4
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
25
256m i1
mradermacher
Params256M
Context2K
Q4_K_M0.2 GB
Tool use
BU
Buddy 2B v1
Buddy · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CA
Cat 8x7B
Cat · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
FR
Frostwind-v2.1-m7
Frostwind · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
tiny aya global strategy agent
Tiny · HatemSaadallah
Params30M
Context—
Smallest0.1 GB
GGUF
ST
StartLux Decision v1 4B BF16
Startlux · startlux-models
Params4.21B
Context256K
Smallest8.4 GB
GGUF
SO
SOLAR 10.7B v1.4
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
BT
4BTestRC
Btestrc · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
GGUF
SE
Seraph 7B
Seraph · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceDrinkNameGoesHereV0RP 7b Model Stock
Icedrinknamegoesherev · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CausalLM RP 34B
Causallm · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
Roleplay
RO
RoMistral 7b Instruct DPO 2024 10 09
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OM
Omnarch 7B i1
Omnarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Salesforce.E1 Code 14B
Code · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use

Keep browsing