GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
PS
PsyMedRP v1 13B
Psymedrp · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GP
TextBase Gpt Oss 20b 1013 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
OM
OmniLing V1 8b experimental
Omniling · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
CohereLabs.command A Reasoning 08 2025
Command · DevQuasar
Params111B
Context488K
Q4_K_M67.1 GB
PL
PLLuM 12B Nc Chat 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
KO
KoSOLAR v0.2 gugutypus 10.7B i1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
DA
Daredevil 7B i1
Daredevil · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DP
OGNO 7B
Dpo · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 3B SciFi QLoRA
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
XL
xLAM-2-32b-fc-r
Xlam · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB
AY
Aya Expanse 8b Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
NE
Nemo 12b Humanize KTO v0.1 i1
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
NE
Beagle14 7B
Neuralbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10.7B v1.3
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
KU
kuno kunoichi v1 DPO v2 SLERP 7B i1
Kuno · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OU
OuteTTS 0.2 500M
Outetts · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
BE
Beagle14 7B i1
Beagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 ChocoLlama 8B instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 Meerkat 8b v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
L3 Nymeria Maid 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
SOLAR 10.7B v1.3
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LL
Llama DNA 1.0 8B Instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
SK
SkunkApe 16b
Skunkape · mradermacher
Params16B
Context4K
Q4_K_M9.6 GB
CH
CHILLGuard 1.7B
Chillguard · mradermacher
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
robinsmits Qwen1.5 7B Dutch Chat
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
FI
FinalFintetuning XVIII 2x8B i1
Finalfintetuning · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
RE
reader lm 1.5b
Reader · MaziyarPanahi
Params1.54B
Context250K
Q4_K_M1.0 GB
DI
DistilabelBeagle14 7B
Distilabelbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoGemma 7b Instruct DPO 2024 10 09
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB