GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
XT
xTower13B
Xtower · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
ST
L3-8B-Stheno-v3.2
Stheno · mrgxxer
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
DU
DukunLM 7B V1.0 Uncensored i1
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
XL
xLAM 7b r
Xlam · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
E Star 12B Base
Star · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
HA
Hammer2.1 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
RE
reverie 7b
Reverie · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
FinalFintetuning-XVIII-2x8B
Finalfintetuning · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
SO
SOLAR 10.7B slerp i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
ME
MetaMath Cybertron Starling
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama-3-Nephilim-v3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
KI
MythoMax L2 Kimiko v2 13b
Kimi · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · second-state
Params10.7B
Context4K
Q4_K_M6.5 GB
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
NE
Neeto 1.0 8b
Neeto · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Nethena-13B
Nethena · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SH
YuE2-3B
Sheetsage · thepatch
Params677M
Context24K
Q4_K_M2.5 GB
SH
SHRDFU 7b delta
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CH
L3-8B-Chara-v1-Alpha
Chara · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
jinaai/test-qwen25-coder-jina-code-embeddings-0.5b
Qwen · jinaai
Params494M
Context32K
Smallest0.3 GB
GE
geitje-7b-ultra
Geitje · BramVanroy
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB