GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
Luban Marcoroni 13B v2
Luban · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RO
RoGemma 7b Instruct 2024 10 09
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AR
Arsenic Shahrazad 12B v4.4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
VY
VyvoTTS LFM2 Itto
Vyvotts · mradermacher
Params383M
Context125K
Q4_K_M0.3 GB
Tool use
AI
AISquare Instruct SOLAR 10.7b v0.5.31
Aisquare · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
KA
Kallamni 4b v1
Kallamni · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
NA
NarumashiRTS 7B V2 1 i1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
LL
Llama 3 Unholy 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v7
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NY
Nyxene 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
GP
HyperClassifier Gpt Oss 20b Qat 0226 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
SO
SJ SOLAR 10.7b DPO i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
LO
Lonepino 11B i1
Lonepino · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
QW
AceMath 72B Instruct
Qwen · redponike
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BU
Buttocks 7B v1.0
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Vex Amber Mini 1.2
Vex · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ON
ONS SOLAR 10.7B v1.2
Ons · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
SO
SolarM SakuraSolar SLERP
Solarm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.9
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
SI
Axton v6 Merged
Simpletool · hiteshluke
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
OM
OmniVoice-tokenizer
Omnivoice · ldov
Params613M
Context40K
Q4_K_M0.3 GB
GGUF
MI
L3.1 70b Milasha
Milasha · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
LDCC Instruct Llama 2 Ko 13B v1.5
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
4i ai Llama 2 13b alpaca es
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral 7B claude instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
BeaverLegacy Moist Miqu 70B v1.1
Beaverlegacy · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
RO
rogue-enchantress-32k-7B
Rogue · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing