GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
CO
C4Ai-Command-A-03-2025
Command R · unsloth
Params111B
Context256K
Q4_K_M67.1 GB
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
ML
MLewd L2 Chat 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
AI
Airoboros 33b Gpt4 1.3
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
TO
Tora 7B v0.1
Tora · MCZK
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Mizan 27B Turkish Legal LLM Q4_K_M
Qwen · AlicanKiraz0
Params26.9B
Context256K
Q4_K_M16.5 GB
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
L3-8B-Stheno-v3.2
Stheno · Den4iiks
Params8.03B
Context8K
Q4_K_M4.9 GB
FL
FlatOrcamaid 13b v0.2
Flatorcamaid · NeverSleep
Params13B
Context4K
Q4_K_M7.9 GB
CR
Creative Writer v0.1 Charlie 35b
Creative · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
AL
AlphaMonarch daser
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EN
ENERGY DRINK LOVE leaderboard inst v1.3 Open Hermes LDCC SOLAR 10.7B DPOv3
Energy · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
MI
NeuraLake m7 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx5_MoE_30B
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
TH
cgato/L3-TheSpice-8b-v0.8.3
Thespice · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
Undi95/ReMM-v2.2-L2-13B
Remm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
RO
RoGemma-7b-Instruct
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
KO
KolmOCR_v251129
Kolmocr · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
NO
Noromaid 13b v0.2
Noromaid · QuantFactory
Params13B
Context4K
Q4_K_M7.9 GB
MO
Moistral 11B v3
Moistral · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
MA
Mangione 12B Model_Stock
Mangione · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GA
Galgame Llasa 1B v2
Galgame · mradermacher
Params1.37B
Context128K
Q4_K_M0.9 GB
AR
ArchBeagle 7B i1
Archbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OX
OxytocinErosEngineeringFX 7B slerp
Oxytocinerosengineeringf · weezywitasneezy
Params7.24B
Context32K
Smallest7.7 GB
ON
ONS SOLAR 10.7B v1.2
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
UL
UltraMerge 7B
Ultramerge · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB