GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
RO
rogue-enchantress-32k-7B
Rogue · grimjim
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LU
Lumimaid v0.2 70B Heretic
Lumimaid · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LU
L3-SAO-MIX-8B-V1
Lunaris · bluuwhale
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
MLewd Chat v2 13B i1
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NY
Nyxene v1 11B
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LE
Lewd Sydney 20B i1
Lewd · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
UN
Unholy v1 10l 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AI
Airoboros 13b Gpt4 1.2
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
MI
MistralDarwin 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheSalt-L3-8b-v0.3.2
Thesalt · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
Solar OrcaDPO Solar Instruct SLERP
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
XL
xLAM 8x22b R
Xlam · RichardErkhov
Params141B
Context64K
Smallest46.2 GB
CO
C4ai Command R 08 2024 34B
Command R · backyardai
Params32.3B
Context128K
Q4_K_M19.8 GB
SM
SmolLM 1.7B Instruct_qlora_nf4_merged
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
WE
West Maid 7B i1
West · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Instruct DADA
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
XL
xLAM 1b Fc R
Xlam · second-state
Params1.35B
Context16K
Q4_K_M0.9 GB
BR
Machynlleth 3B Instruct
Britllm · jonpojonpo
Params2.67B
Context2K
Q4_K_M1.7 GB
TH
L3-TheSpice-8b-v0.1.3
Thespice · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
IC
IceLemonTeaRP 32k 7b
Icelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
DA
DataVortexS 10.7B Dpo v1.11
Datavortexs · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
EH
EHR R1 1.7B
Ehr · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ZE
mlabonne/Zebrafish-7B
Zebrafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
YuE2 Oobleck VAE
Mert · ldov
Params677M
Context—
Smallest0.5 GB
LL
Llama 3SOME 8B v1 i1
Llama · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Nahida RP V2
Qwen · Moranyunchen
Params4.21B
Context256K
Q4_K_M2.7 GB
AR
Arsenic Shahrazad 12B v4.3
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LA
Lacia sum small v1
Lacia · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
CO
C4Ai Command R Plus 08 2024
Command R · mmnga
Params104B
Context128K
Smallest23.2 GB