GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.6 35B Zenith Abliterated
Qwen · eggdog100
Params34.7B
Context256K
Q4_K_M21.2 GB
BA
l3-badger-mushroom-4x8b
Badger · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
EU
Euryale-1.3-Small-7B
Euryale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
Ice0.83 04.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BO
BondBurger 8x7B i1
Bondburger · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
AI
Airoboros 13b
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
NA
Nautilus RP 18B
Nautilus · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
WE
West Maid 7B
West · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
TeeZee Buttocks 7B v1.0
Teezee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiaLatte Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Undi95 UndiMix v1 13b
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
WI
Wiederchat 7b
Wiederchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GH
ghana voice buli
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
OM
OmniVoice-tokenizer
Omnivoice · agentory
Params613M
Context40K
Q4_K_M0.3 GB
JI
jina-ocr-v1
Jina · cstr
Params3.34B
Context—
Smallest2.3 GB
JS
Jsoo solar ko common slerp
Jsoo · RichardErkhov
Params10.5B
Context4K
Q4_K_M6.3 GB
BO
BondBurger 8x7B
Bondburger · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
grimjim/Llama-3-Oasis-v1-OAS-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Patronus-Lynx-8B-Instruct
Llama · PatronusAI
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grimjim/llama-3-merge-pp-instruct-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOVL Mega Mash V2 L3 8B
Sovl · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · Melvin56
Params2.09B
Context8K
Q4_K_M1.4 GB
DP
DPOB NMTOB 7B
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
abideen starcoder2 chat
StarCoder · RichardErkhov
Params7.17B
Context16K
Q4_K_M4.5 GB
QW
factusight 4B
Qwen · manuelgscom
Params4.21B
Context256K
Q4_K_M2.7 GB
CO
contriever
Contriever · masahiroid
Params109M
Context—
Smallest0.4 GB
HA
L3.1 70B Hanami X1
Hanami · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
smelborp MixtralOrochi8x7B Alt
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
PL
Plap 8x13B
Plap · mradermacher
Params72.5B
Context32K
Q4_K_M45.1 GB