GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-10fail-1000total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
Hemmingway 1 Unlocked
Hemmingway · newsletter
Params934M
Context—
Smallest1.9 GB
JI
Jina Embeddings v5 Text Small Classification
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
CO
Command R 35b Writer
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
SP
SpireFull v2
Spirefull · mradermacher
Params6.78B
Context4K
Q4_K_M4.1 GB
FI
Finance Embeddings Investopedia
Finance · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
VI
VieNeu TTS 0.3B q8
Vieneu · pnnbao-ump
Params294M
Context4K
Smallest0.3 GB
QW
Qwen2.5 0.5B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params494M
Context32K
Q4_K_M0.4 GB
LL
Llama 3 8B MLP
Llama · secretmoon
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
Tiny Viking 1.1b v0.1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MA
maestrale chat v0.3 beta sft
Maestrale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Instruct ortho baukit toxic n128 v3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kunoichi Lemon Royale V2Experiment1 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
AR
Arsenic Shahrazad 12B v4.1
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TO
TowerInstruct 7B v0.1 i1
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
grimjim llama 3 merge pp instruct 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
FR
Frontis-MA1-35B
Frontis · FrontisAI
Params34.7B
Context256K
Q4_K_M21.2 GB
SO
pinkyponky/SOLAR-10.7B-dpo-instruct-tuned-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
UN
Undi95 Utopia 13B
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
CH
ChatWaifu_v2.0_22B
Chatwaifu · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
TE
TextTopic 8B Flash
Texttopic · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
RE
reader lm 1.5b
Reader · mradermacher
Params1.54B
Context250K
Q4_K_M1.0 GB
NE
NeuBeagle 7B
Neubeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
VongolaChouko/Starcannon-Unleashed-12B-v1.0
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
OC
Octopus v2
Octopus · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
CR
Creative Writer 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
HE
Hemmingway 1 Heretic MTP GGUF V2
Hemmingway · brainnxdomain
Params27.3B
Context256K
Q4_K_M16.8 GB
CI
CircleZone 2.0 70M Think
Circlezone · IAMPOOM
Params70M
Context512
Smallest0.1 GB
IC
IceCoffeeRP 7b
Icecoffeerp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kunoichi Lemon Royale V2Experiment2 32K 7B
Kunoichi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB