GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralOmniBeagleMBX v3 7B i1
Neuralomnibeaglembx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoMistral 7b Instruct DPO
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alsebay/Narisumashi-11B-v1.5
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ZE
Royallab ZephRP M7B
Zephrp · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
RO
RoMistral 7b Instruct 2024 05 17
Romistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SM
Smegmma-9B-v1
Smegmma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
XL
xLAM 8x7b R
Xlam · DevQuasar-4
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
RO
RoGemma2 9b Instruct 2024 10 09
Rogemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MO
MobileLLM 125M HF
Mobilellm · mradermacher
Params125M
Context2K
Q4_K_M0.1 GB
GGUF
GA
Galgame Llasa 1B v3
Galgame · mradermacher
Params1.37B
Context128K
Q4_K_M0.9 GB
Tool use
SL
SLM SQL Base 1.3B
Slm · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
FI
Fimbulvetr 11B v2
Fimbulvetr · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ST
starcoder2 chat
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
Coding
NE
NeuralBeagleJaskier
Neuralbeaglejaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemo 12b Humanize KTO v0.1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
TI
batwan tiny aya
Tiny · alsersugasawa
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
KE
kellemar DPO Orca Distilled 7B SLERP
Kellemar · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoLlama3.1 8b Instruct
Rollama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
AI
Airoboros 7b Gpt4 1.1
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TO
TowerFull
Towerfull · mradermacher
Params6.78B
Context4K
Q4_K_M4.1 GB
GGUF
LL
kimwooglae WebSquareAI Instruct llama 3 8B v0.5.39
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VE
Verdict 8x7B
Verdict · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AG
L3.1 Aglow Vulca V0.1 8B
Aglow · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama DNA 1.0 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
mongolian stt asr nemotron v13m
Nemotron · sergei10a
Params639M
Context—
Smallest0.9 GB
GGUF
PL
PLLuM 8x7B nc instruct
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TE
Tev 27B
Tev · siddhu1983
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
AM
Amber Fable 1.0
Amber · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
CodingReasoningTool use
CR
Creative Writer 35b Preview
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF

Keep browsing