GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
rogue-enchantress-32k-7B
Rogue · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LU
Lumimaid v0.2 70B Heretic
Lumimaid · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LU
L3-SAO-MIX-8B-V1
Lunaris · bluuwhale
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
MLewd Chat v2 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NY
Nyxene v1 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LE
Lewd Sydney 20B i1
Lewd · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
UN
Unholy v1 10l 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros 13b Gpt4 1.2
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
MistralDarwin 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheSalt-L3-8b-v0.3.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
XL
xLAM 8x22b R
Xlam · RichardErkhov
Params141B
Context64K
Smallest46.2 GB
Tool use
CO
C4ai Command R 08 2024 34B
Command R · backyardai
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
SM
SmolLM 1.7B Instruct_qlora_nf4_merged
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
WE
West Maid 7B i1
West · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Instruct DADA
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
XL
xLAM 1b Fc R
Xlam · second-state
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
BR
Machynlleth 3B Instruct
Britllm · jonpojonpo
Params2.67B
Context2K
Q4_K_M1.7 GB
GGUF
TH
L3-TheSpice-8b-v0.1.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IC
IceLemonTeaRP 32k 7b
Icelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
EH
EHR R1 1.7B
Ehr · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
ZE
mlabonne/Zebrafish-7B
Zebrafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
YuE2 Oobleck VAE
Mert · ldov
Params677M
Context—
Smallest0.5 GB
GGUF
LL
Llama 3SOME 8B v1 i1
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B Nahida RP V2
Qwen · Moranyunchen
Params4.21B
Context256K
Q4_K_M2.7 GB
RoleplayVision
AR
Arsenic Shahrazad 12B v4.3
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LA
Lacia sum small v1
Lacia · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB
GGUF

Keep browsing