GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LU
Luban Marcoroni 13B v2
Luban · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
RO
RoGemma 7b Instruct 2024 10 09
Rogemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
AR
Arsenic Shahrazad 12B v4.4
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
VY
VyvoTTS LFM2 Itto
Vyvotts · mradermacher
Params383M
Context125K
Q4_K_M0.3 GB
AI
AISquare Instruct SOLAR 10.7b v0.5.31
Aisquare · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
KA
Kallamni 4b v1
Kallamni · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NA
NarumashiRTS 7B V2 1 i1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3 Unholy 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LDCC Instruct Llama 2 Ko 13B v7
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
NY
Nyxene 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GP
HyperClassifier Gpt Oss 20b Qat 0226 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
SO
SJ SOLAR 10.7b DPO i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
LO
Lonepino 11B i1
Lonepino · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
AceMath 72B Instruct
Qwen · redponike
Params72.7B
Context4K
Q4_K_M47.4 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · mradermacher
Params8.04B
Context1048K
Q4_K_M4.9 GB
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BU
Buttocks 7B v1.0
Buttocks · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Vex Amber Mini 1.2
Vex · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
BU
Buddy 2B v1
Buddy · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
ON
ONS SOLAR 10.7B v1.2
Ons · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
SO
SolarM SakuraSolar SLERP
Solarm · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DataVortexS 10.7B Dpo v1.9
Datavortexs · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
SI
Axton v6 Merged
Simpletool · hiteshluke
Params494M
Context32K
Q4_K_M0.4 GB
OM
OmniVoice-tokenizer
Omnivoice · ldov
Params613M
Context40K
Q4_K_M0.3 GB
MI
L3.1 70b Milasha
Milasha · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
LDCC Instruct Llama 2 Ko 13B v1.5
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
4i ai Llama 2 13b alpaca es
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral 7B claude instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
BeaverLegacy Moist Miqu 70B v1.1
Beaverlegacy · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
RO
rogue-enchantress-32k-7B
Rogue · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB