GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
MI
OpenMia Indo Mistral 7b v4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
icefog72/IceTeaRP-7b
Icetearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
WestKunai XS 7b
Westkunai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Dnotitia Llama DNA 1.0 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
AU
saishf/Aura-Uncensored-OAS-8B-L3
Aura · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TH
Thespis CurtainCall 7b v0.3
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyUltra 4x1.1B Base Alpha
Tinyultra · mradermacher
Params3.38B
Context2K
Q4_K_M2.0 GB
RE
ReMM v2 L2 13B
Remm · Undi95
Params13B
Context4K
Smallest7.4 GB
LL
Llama 3 8B Kolon ITD 5 v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MY
MyriadStrangemerges 32 7B
Myriadstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
FI
FiscMind AI v9
Fiscmind · iulio
Params12.2B
Context128K
Q4_K_M7.5 GB
ON
Onca 3.0 12b
Onca · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ES
v000000 MN 12B Estrella v2.2
Estrella · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceSakeRPTrainingTestV1 7b i1
Icesakerptrainingtestv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Undi95/Llama-3-LewdPlay-8B-evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
upstage/SOLAR-10.7B-Instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
MiniusLight 24B v1.01
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Frostwind Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MU
song2midi muscriptor
Muscriptor · Vladmoon
Params1.37B
Context—
Smallest0.2 GB
TI
tiny aya global unlearn bio circuitkit 4bit aware
Tiny · itssaharsh
Params3.35B
Context488K
Q4_K_M2.1 GB
CH
ChatWaifu_v1.2.1
Chatwaifu · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
NA
NarumashiRTS 7B V2 1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
DA
DaringMaid 13B
Daringmaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MO
Monarch 7B dare
Monarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Aya Expanse 32b
Aya · Abu-Dju
Params32.3B
Context8K
Smallest23.1 GB
QW
CscSQL Grpo XiYanSQL QwenCoder 7B 2502
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
KA
kallamni 4b v1
Kallamni · yasserrmd
Params4.02B
Context256K
Q4_K_M2.5 GB
EL
elinas Chronos Gold 12B 1.0
Elinas · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB