GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
laser dolphin mixtral 2x7b dpo
Mistral · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
NA
Narisumashi-11B-v1.5
Narisumashi · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
Roleplay
HO
Holo4 27B Abliterix GSQ RCO
Holo · lavendercomputing
Params26.9B
Context256K
Smallest0.5 GB
ReasoningTool useVision
AY
aya-23-35B
Aya · bartowski
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
RA
raon speech 9b
Raon · cstr
Params8.55B
Context—
Smallest5.0 GB
GGUF
SI
Silicon-Masha-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
Nethena MLewd Xwin 23B
Nethena · TheBloke
Params22.8B
Context4K
Q4_K_M13.8 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ST
L3-8B-Stheno-v3.3-32K
Stheno · backyardai
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
ON
ONS SOLAR 10.7B v1.2
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
LY
MN 12B Lyra v4 Heretic
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
QW
Qwen3.5 4B NekoCOT
Qwen · starryhoshi
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningRoleplayTool use
SA
FL 7B 3.1 Safetensors
Safetensors · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
PO
Poppy Porpoise 1.0 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
CU
cuckoo-starling-7B
Cuckoo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Asclepius Llama2 13B Pretraining Only
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
ReasoningTool useVision
SO
SOLAR 10.7B v1.2
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
AC
AceInstruct 72B
Aceinstruct · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Coding
JI
jina-reranker-v3
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
Embedding
SO
Solstice-11B-v1
Solstice · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
L3 8B Stheno v3.2 Heretic
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CH
Chronos Divergence 33B
Chronos · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
NY
L3 Nymeria 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Airoboros 13b Gpt4 1.1
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing