GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
Thespis LucyWantsToQuantEdition 7b v0.1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
VongolaChouko.Starcannon Unleashed 12B v1.0
Starcannon · DevQuasar-3
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CA
CarbonVillain en 10.7B v1
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
QW
Qwen2.5 0.5B SFT OpenHermes 2.5 100
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LO
Loyal Piano M7
Loyal · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JI
jinaai reader lm 1.5b
Jinaai · RichardErkhov
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
JI
jina ocr v1 Q8 0 mtp
Jina · qenme
Params2.97B
Context32K
Smallest3.2 GB
GGUF
PL
PLLuM 12B Nc Chat 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AL
algograpV4
Algograpv · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SOLAR 10.7B v1.3
Solar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
CO
Command R 32b Writer
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
IC
IceWhiskeyRP 7b
Icewhiskeyrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
tannedbum/L3-Nymeria-v2-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
DaringMaid 20B V1.1
Daringmaid · Kooten
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
IC
IceSakeRPTrainingTestV1 7b
Icesakerptrainingtestv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
EdgerunnersArchive/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
IT
ITT Yi Ko 6B v6.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
GU
Guru 7b Step320
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
SU
survival ai
Survival · Cholarajarp
Params1B
Context32K
Smallest0.8 GB
GGUF
CO
Agatha 111B v1
Command R · quantized4all
Params111B
Context256K
Smallest25.4 GB
Tool use
LL
LLama 3.1 KazLLM 1.0 8B GGUF4
Llama · issai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BR
BrokenKeyboard
Brokenkeyboardmerge · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
AC
nvidia/AceMath-7B-Instruct
Acemath · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
SO
SJ SOLAR 10.7b DPO
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
KU
finch
Kunoichi · antiven0m
Params7.24B
Context32K
Smallest3.5 GB
GGUF
UN
Undi95 MLewdBoros L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AL
AlphaMonarch daser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing