GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PS
PsyMedRP v1 13B
Psymedrp · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GP
TextBase Gpt Oss 20b 1013 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
OM
OmniLing V1 8b experimental
Omniling · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CohereLabs.command A Reasoning 08 2025
Command · DevQuasar
Params111B
Context488K
Q4_K_M67.1 GB
ReasoningTool use
PL
PLLuM 12B Nc Chat 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KO
KoSOLAR v0.2 gugutypus 10.7B i1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
DA
Daredevil 7B i1
Daredevil · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
DP
OGNO 7B
Dpo · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B SciFi QLoRA
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
XL
xLAM-2-32b-fc-r
Xlam · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
Tool use
AY
Aya Expanse 8b Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NE
Nemo 12b Humanize KTO v0.1 i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
NE
Beagle14 7B
Neuralbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10.7B v1.3
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
KU
kuno kunoichi v1 DPO v2 SLERP 7B i1
Kuno · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
BE
Beagle14 7B i1
Beagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 ChocoLlama 8B instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Meerkat 8b v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
L3 Nymeria Maid 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR 10.7B v1.3
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama DNA 1.0 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SK
SkunkApe 16b
Skunkape · mradermacher
Params16B
Context4K
Q4_K_M9.6 GB
GGUF
CH
CHILLGuard 1.7B
Chillguard · mradermacher
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
robinsmits Qwen1.5 7B Dutch Chat
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
FI
FinalFintetuning XVIII 2x8B i1
Finalfintetuning · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
RE
reader lm 1.5b
Reader · MaziyarPanahi
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
DI
DistilabelBeagle14 7B
Distilabelbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoGemma 7b Instruct DPO 2024 10 09
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF

Keep browsing