GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-10fail-1000total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
Hemmingway 1 Unlocked
Hemmingway · newsletter
Params934M
Context—
Smallest1.9 GB
GGUF
JI
Jina Embeddings v5 Text Small Classification
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
CO
Command R 35b Writer
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
SP
SpireFull v2
Spirefull · mradermacher
Params6.78B
Context4K
Q4_K_M4.1 GB
GGUF
FI
Finance Embeddings Investopedia
Finance · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Embedding
VI
VieNeu TTS 0.3B q8
Vieneu · pnnbao-ump
Params294M
Context4K
Smallest0.3 GB
GGUF
QW
Qwen2.5 0.5B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Llama 3 8B MLP
Llama · secretmoon
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
Tiny Viking 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MA
maestrale chat v0.3 beta sft
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Instruct ortho baukit toxic n128 v3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunoichi Lemon Royale V2Experiment1 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arsenic Shahrazad 12B v4.1
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
TO
TowerInstruct 7B v0.1 i1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
grimjim llama 3 merge pp instruct 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FR
Frontis-MA1-35B
Frontis · FrontisAI
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
SO
pinkyponky/SOLAR-10.7B-dpo-instruct-tuned-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UN
Undi95 Utopia 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
ChatWaifu_v2.0_22B
Chatwaifu · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
TE
TextTopic 8B Flash
Texttopic · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
RE
reader lm 1.5b
Reader · mradermacher
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
NE
NeuBeagle 7B
Neubeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
VongolaChouko/Starcannon-Unleashed-12B-v1.0
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OC
Octopus v2
Octopus · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CR
Creative Writer 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
HE
Hemmingway 1 Heretic MTP GGUF V2
Hemmingway · brainnxdomain
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
CI
CircleZone 2.0 70M Think
Circlezone · IAMPOOM
Params70M
Context512
Smallest0.1 GB
Reasoning
IC
IceCoffeeRP 7b
Icecoffeerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Kunoichi Lemon Royale V2Experiment2 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing