GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
KU
Kuno Lake 7B
Kuno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ML
mlabonne AlphaMonarch 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
HOTHUN Stheno 3.2 v1.3
Hothun · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
EmbeddedLLM Mistral 7B Merge 14 v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
ON
ONeil-model_stock-8B
Oneil · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
Novus-7b-tr_v1
Daredevil · helizac
Params7.24B
Context32K
Q4_K_M4.4 GB
PR
Proctora
Proctora · Artefact2
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Miqu PlayMaid 70B v0.1 i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GU
Guru 32B
Guru · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
OmniLing V1 12b experimental
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
NyakuraV2 34B Yi Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
UN
Unholy v1.1 13B i1
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ML
MLewd v2.4 13B
Mlewd · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
KU
Kuro Lotus 10.7B
Kuro · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
HE
heretic_xLAM 2 1b Fc R
Heretic · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
LDCC LDCC Instruct Llama 2 ko 13B v1.7
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
AR
Arsenic Shahrazad 12B v4.4.2 Mtp
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TH
Thespis CurtainCall 7b v0.3
Thespis · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
XL
xLAM 7b Fc R
Xlam · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
PL
PLLuM 8x7B Nc Chat
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 11B OmniMix
Mistral · Undi95
Params10.7B
Context32K
Q4_K_M6.5 GB
MA
E1 Math 1.5B
Math · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
SA
Sao10K L3 8B Niitama v1
Sao · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
Coomand R 35B v1
Coomand · BeaverLegacy
Params35B
Context128K
Q4_K_M21.5 GB
LL
Llamix2 MLewd 4x13B i1
Llamix · mradermacher
Params38.5B
Context32K
Q4_K_M23.3 GB
LL
Llama xLAM 2 70b Fc R
Llama · DevQuasar-13
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-2fail-128total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AI
Airoboros 13b Gpt4 1.2
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
KE
musicgen-keygen-gary-v2-large-12-3.3B-v1.0-F16
Keygen · thepatch
Params58M
Context—
Q4_K_M2.2 GB
LL
Llama 3 Luminurse v0.1 OAS 8B
Llama · grimjim
Params8.03B
Context8K
Q4_K_M4.9 GB