GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
XT
xTower13B
Xtower · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · mrgxxer
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
DU
DukunLM 7B V1.0 Uncensored i1
Dukunlm · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
XL
xLAM 7b r
Xlam · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ST
E Star 12B Base
Star · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
HA
Hammer2.1 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
RE
reverie 7b
Reverie · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
FinalFintetuning-XVIII-2x8B
Finalfintetuning · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
SO
SOLAR 10.7B slerp i1
Solar · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
ME
MetaMath Cybertron Starling
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama-3-Nephilim-v3-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
KI
MythoMax L2 Kimiko v2 13b
Kimi · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · second-state
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
RE
reader lm 1.5b
Reader · bartowski
Params1.54B
Context250K
Q4_K_M1.0 GB
GGUF
NE
Neeto 1.0 8b
Neeto · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Nethena-13B
Nethena · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SH
YuE2-3B
Sheetsage · thepatch
Params677M
Context24K
Q4_K_M2.5 GB
GGUF
SH
SHRDFU 7b delta
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
ML
MLewdBoros LRPSGPT 2Char 13B
Mlewdboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Steerpike-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CH
L3-8B-Chara-v1-Alpha
Chara · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
jinaai/test-qwen25-coder-jina-code-embeddings-0.5b
Qwen · jinaai
Params494M
Context32K
Smallest0.3 GB
CodingEmbedding
GE
geitje-7b-ultra
Geitje · BramVanroy
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF

Keep browsing