GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
RoLlama2 7b Instruct DPO 2025 04 23
Rollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OM
Omnia 2x7B
Omnia · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
NE
Nethena-13B
Nethena · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TH
L3-TheSpice-8b-v0.8.3
Thespice · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
JP
jpt 9b
Jpt · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GO
GodziLLa 30B
Godzilla · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
ST
Starcannon Unleashed 12B v1.0 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FI
fibo 2.0
Fibo · molbal
Params8.23B
Context—
Q4_K_M5.5 GB
GGUF
RE
reader lm 1.5b
Reader · QuantFactory
Params1.78B
Context250K
Q4_K_M1.1 GB
GGUF
FI
finch
Finch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
JI
jina embeddings v5 omni nano clustering
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingReasoningTool use
LO
sanjiwatsuki_loyal-macaroni-maid-7b
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
IA
Iambe 20b DARE v2
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
ED
EduMixtral 4x7B
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CH
ChocoLlama 2 7B instruct i1
Chocollama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LY
MN 12B Lyra v1 i1
Lyra · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DN
dnotitia DNA R1
Dna · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
TR
Trinas Nectar 8B model stock
Trinas · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
ST
StartLux Decision v1 2B Q4 K M
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
CO
Command R 35b Writer v2
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
GGUF
XL
Models Salesforce xLAM 8x22b R
Xlam · MaziyarPanahi
Params141B
Context64K
Q4_K_M38.4 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
VE
MN 12B Vespa x1
Vespa · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing