GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NE
NeuralOmniBeagleMBX v3 7B i1
Neuralomnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoMistral 7b Instruct DPO
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alsebay/Narisumashi-11B-v1.5
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
ZE
Royallab ZephRP M7B
Zephrp · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
RO
RoMistral 7b Instruct 2024 05 17
Romistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SM
Smegmma-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
XL
xLAM 8x7b R
Xlam · DevQuasar-4
Params46.7B
Context32K
Q4_K_M28.4 GB
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
RO
RoGemma2 9b Instruct 2024 10 09
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MO
MobileLLM 125M HF
Mobilellm · mradermacher
Params125M
Context2K
Q4_K_M0.1 GB
GA
Galgame Llasa 1B v3
Galgame · mradermacher
Params1.37B
Context128K
Q4_K_M0.9 GB
SL
SLM SQL Base 1.3B
Slm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
ST
starcoder2 chat
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
NE
NeuralBeagleJaskier
Neuralbeaglejaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemo 12b Humanize KTO v0.1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
TI
batwan tiny aya
Tiny · alsersugasawa
Params3.35B
Context8K
Q4_K_M2.1 GB
KE
kellemar DPO Orca Distilled 7B SLERP
Kellemar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama3.1 8b Instruct
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AI
Airoboros 7b Gpt4 1.1
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
TO
TowerFull
Towerfull · mradermacher
Params6.78B
Context4K
Q4_K_M4.1 GB
LL
kimwooglae WebSquareAI Instruct llama 3 8B v0.5.39
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
VE
Verdict 8x7B
Verdict · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AG
L3.1 Aglow Vulca V0.1 8B
Aglow · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
mongolian stt asr nemotron v13m
Nemotron · sergei10a
Params639M
Context—
Smallest0.9 GB
PL
PLLuM 8x7B nc instruct
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TE
Tev 27B
Tev · siddhu1983
Params26.9B
Context256K
Q4_K_M16.5 GB
AM
Amber Fable 1.0
Amber · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CR
Creative Writer 35b Preview
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB