GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
OpenMia Indo Mistral 7b v4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
icefog72/IceTeaRP-7b
Icetearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestKunai XS 7b
Westkunai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Dnotitia Llama DNA 1.0 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
AU
saishf/Aura-Uncensored-OAS-8B-L3
Aura · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TH
Thespis CurtainCall 7b v0.3
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyUltra 4x1.1B Base Alpha
Tinyultra · mradermacher
Params3.38B
Context2K
Q4_K_M2.0 GB
GGUF
RE
ReMM v2 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
GGUF
LL
Llama 3 8B Kolon ITD 5 v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MY
MyriadStrangemerges 32 7B
Myriadstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
FI
FiscMind AI v9
Fiscmind · iulio
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
ON
Onca 3.0 12b
Onca · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
ES
v000000 MN 12B Estrella v2.2
Estrella · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceSakeRPTrainingTestV1 7b i1
Icesakerptrainingtestv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Undi95/Llama-3-LewdPlay-8B-evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
upstage/SOLAR-10.7B-Instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MiniusLight 24B v1.01
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Frostwind Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MU
song2midi muscriptor
Muscriptor · Vladmoon
Params1.37B
Context—
Smallest0.2 GB
GGUF
TI
tiny aya global unlearn bio circuitkit 4bit aware
Tiny · itssaharsh
Params3.35B
Context488K
Q4_K_M2.1 GB
GGUF
CH
ChatWaifu_v1.2.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
NA
NarumashiRTS 7B V2 1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
DA
DaringMaid 13B
Daringmaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
Monarch 7B dare
Monarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 32b
Aya · Abu-Dju
Params32.3B
Context8K
Smallest23.1 GB
GGUF
QW
CscSQL Grpo XiYanSQL QwenCoder 7B 2502
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
KA
kallamni 4b v1
Kallamni · yasserrmd
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
EL
elinas Chronos Gold 12B 1.0
Elinas · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing