GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
MI
laser dolphin mixtral 2x7b dpo
Mistral · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
NA
Narisumashi-11B-v1.5
Narisumashi · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
HO
Holo4 27B Abliterix GSQ RCO
Holo · lavendercomputing
Params26.9B
Context256K
Smallest0.5 GB
AY
aya-23-35B
Aya · bartowski
Params35B
Context8K
Q4_K_M21.5 GB
RA
raon speech 9b
Raon · cstr
Params8.55B
Context—
Smallest5.0 GB
SI
Silicon-Masha-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
NE
Nethena MLewd Xwin 23B
Nethena · TheBloke
Params22.8B
Context4K
Q4_K_M13.8 GB
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ST
L3-8B-Stheno-v3.3-32K
Stheno · backyardai
Params8B
Context32K
Q4_K_M4.9 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
ON
ONS SOLAR 10.7B v1.2
Ons · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
LY
MN 12B Lyra v4 Heretic
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HO
Holo2 30B A3B
Holo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 4B NekoCOT
Qwen · starryhoshi
Params4.33B
Context256K
Q4_K_M2.8 GB
SA
FL 7B 3.1 Safetensors
Safetensors · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
TH
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PO
Poppy Porpoise 1.0 L3 8B GGUF IQ Imatrix
Poppy · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
CU
cuckoo-starling-7B
Cuckoo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Asclepius Llama2 13B Pretraining Only
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
SO
SOLAR 10.7B v1.2
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
AC
AceInstruct 72B
Aceinstruct · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
JI
jina-reranker-v3
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
SO
Solstice-11B-v1
Solstice · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Asclepius Llama2 7B Pretraining Only
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
L3 8B Stheno v3.2 Heretic
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Lumimaid v0.2 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
Chronos Divergence 33B
Chronos · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
NY
L3 Nymeria 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
Airoboros 13b Gpt4 1.1
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB