GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
TH
Thespis LucyWantsToQuantEdition 7b v0.1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
VongolaChouko.Starcannon Unleashed 12B v1.0
Starcannon · DevQuasar-3
Params12.2B
Context1000K
Q4_K_M7.5 GB
CA
CarbonVillain en 10.7B v1
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
QW
Qwen2.5 0.5B SFT OpenHermes 2.5 100
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
LO
Loyal Piano M7
Loyal · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JI
jinaai reader lm 1.5b
Jinaai · RichardErkhov
Params1.54B
Context250K
Q4_K_M1.0 GB
JI
jina ocr v1 Q8 0 mtp
Jina · qenme
Params2.97B
Context32K
Smallest3.2 GB
PL
PLLuM 12B Nc Chat 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AL
algograpV4
Algograpv · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
SO
SOLAR 10.7B v1.3
Solar · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
CO
Command R 32b Writer
Command R · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
IC
IceWhiskeyRP 7b
Icewhiskeyrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
tannedbum/L3-Nymeria-v2-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
DaringMaid 20B V1.1
Daringmaid · Kooten
Params20B
Context4K
Q4_K_M12.0 GB
IC
IceSakeRPTrainingTestV1 7b
Icesakerptrainingtestv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
EdgerunnersArchive/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AY
aya-23-8B
Aya · legraphista
Params8.03B
Context8K
Q4_K_M5.1 GB
IT
ITT Yi Ko 6B v6.0
Itt · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GU
Guru 7b Step320
Guru · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
SU
survival ai
Survival · Cholarajarp
Params1B
Context32K
Smallest0.8 GB
CO
Agatha 111B v1
Command R · quantized4all
Params111B
Context256K
Smallest25.4 GB
LL
LLama 3.1 KazLLM 1.0 8B GGUF4
Llama · issai
Params8.03B
Context128K
Q4_K_M4.9 GB
BR
BrokenKeyboard
Brokenkeyboardmerge · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
AC
nvidia/AceMath-7B-Instruct
Acemath · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
SO
SJ SOLAR 10.7b DPO
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
KU
finch
Kunoichi · antiven0m
Params7.24B
Context32K
Smallest3.5 GB
UN
Undi95 MLewdBoros L2 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AL
AlphaMonarch daser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemo 12b TheSpice V0.9 All v2
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB