GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B Zenith Abliterated
Qwen · eggdog100
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
BA
l3-badger-mushroom-4x8b
Badger · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
GGUF
EU
Euryale-1.3-Small-7B
Euryale · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
Ice0.83 04.02 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
BO
BondBurger 8x7B i1
Bondburger · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
AI
Airoboros 13b
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NA
Nautilus RP 18B
Nautilus · mradermacher
Params18.2B
Context1000K
Q4_K_M11.1 GB
RoleplayTool use
WE
West Maid 7B
West · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
TeeZee Buttocks 7B v1.0
Teezee · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiaLatte Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Undi95 UndiMix v1 13b
Undi · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
Wiederchat 7b
Wiederchat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GH
ghana voice buli
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
GGUF
OM
OmniVoice-tokenizer
Omnivoice · agentory
Params613M
Context40K
Q4_K_M0.3 GB
GGUF
JI
jina-ocr-v1
Jina · cstr
Params3.34B
Context—
Smallest2.3 GB
GGUF
JS
Jsoo solar ko common slerp
Jsoo · RichardErkhov
Params10.5B
Context4K
Q4_K_M6.3 GB
GGUF
BO
BondBurger 8x7B
Bondburger · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
grimjim/Llama-3-Oasis-v1-OAS-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Patronus-Lynx-8B-Instruct
Llama · PatronusAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim/llama-3-merge-pp-instruct-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SO
SOVL Mega Mash V2 L3 8B
Sovl · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KA
Kanana Nano 2.1b Instruct Abliterated
Kanana · Melvin56
Params2.09B
Context8K
Q4_K_M1.4 GB
GGUF
DP
DPOB NMTOB 7B
Dpob · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
abideen starcoder2 chat
StarCoder · RichardErkhov
Params7.17B
Context16K
Q4_K_M4.5 GB
Coding
QW
factusight 4B
Qwen · manuelgscom
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
CO
contriever
Contriever · masahiroid
Params109M
Context—
Smallest0.4 GB
GGUF
HA
L3.1 70B Hanami X1
Hanami · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
smelborp MixtralOrochi8x7B Alt
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
Plap 8x13B
Plap · mradermacher
Params72.5B
Context32K
Q4_K_M45.1 GB
GGUF

Keep browsing