GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
RO
RoLlama2 7b Instruct DPO 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OM
Omnia 2x7B
Omnia · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
NE
Nethena-13B
Nethena · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
TH
L3-TheSpice-8b-v0.8.3
Thespice · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
JP
jpt 9b
Jpt · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GO
GodziLLa 30B
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
ST
Starcannon Unleashed 12B v1.0 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
FI
fibo 2.0
Fibo · molbal
Params8.23B
Context—
Q4_K_M5.5 GB
RE
reader lm 1.5b
Reader · QuantFactory
Params1.78B
Context250K
Q4_K_M1.1 GB
FI
finch
Finch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
JI
jina embeddings v5 omni nano clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
LO
sanjiwatsuki_loyal-macaroni-maid-7b
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
IA
Iambe 20b DARE v2
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
ED
EduMixtral 4x7B
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
CH
ChocoLlama 2 7B instruct i1
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LY
MN 12B Lyra v1 i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
TR
Trinas Nectar 8B model stock
Trinas · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
ST
StartLux Decision v1 2B Q4 K M
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
CO
Command R 35b Writer v2
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
XL
Models Salesforce xLAM 8x22b R
Xlam · MaziyarPanahi
Params141B
Context64K
Q4_K_M38.4 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
VE
MN 12B Vespa x1
Vespa · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB