GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai-Command-A-03-2025
Command R · unsloth
Params111B
Context256K
Q4_K_M67.1 GB
Tool use
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
ML
MLewd L2 Chat 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
AI
Airoboros 33b Gpt4 1.3
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
TO
Tora 7B v0.1
Tora · MCZK
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Mizan 27B Turkish Legal LLM Q4_K_M
Qwen · AlicanKiraz0
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · Den4iiks
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
FL
FlatOrcamaid 13b v0.2
Flatorcamaid · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CR
Creative Writer v0.1 Charlie 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
AL
AlphaMonarch daser
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EN
ENERGY DRINK LOVE leaderboard inst v1.3 Open Hermes LDCC SOLAR 10.7B DPOv3
Energy · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
Tool use
MI
NeuraLake m7 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx5_MoE_30B
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TH
cgato/L3-TheSpice-8b-v0.8.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
Undi95/ReMM-v2.2-L2-13B
Remm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Reasoning
KO
KolmOCR_v251129
Kolmocr · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
GGUF
NO
Noromaid 13b v0.2
Noromaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Moistral 11B v3
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
MA
Mangione 12B Model_Stock
Mangione · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GA
Galgame Llasa 1B v2
Galgame · mradermacher
Params1.37B
Context128K
Q4_K_M0.9 GB
Tool use
AR
ArchBeagle 7B i1
Archbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OX
OxytocinErosEngineeringFX 7B slerp
Oxytocinerosengineeringf · weezywitasneezy
Params7.24B
Context32K
Smallest7.7 GB
GGUF
ON
ONS SOLAR 10.7B v1.2
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
UL
UltraMerge 7B
Ultramerge · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing