GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ST
StartLux Decision v1 9B
Startlux · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GGUF
JI
jina embeddings v5 omni nano retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingVision
TH
Thanos 3B i1
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
BR
Brunhilde 2x7b MOE DPO v.01.5
Brunhilde · mradermacher
Params12.9B
Context32K
Q4_K_M7.9 GB
GGUF
XL
xLAM 2 1b Fc R
Xlam · Salesforce
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
IM
Juggernaut Z Image Fast
Image · RunDiffusion
Params6.15B
Context—
Q4_K_M5.2 GB
GGUF
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GE
Gemmasutra Pro 27B V1F
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
CH
Chronos Divergence 33B i1
Chronos · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
Roleplay
EC
Echidna-13b-v0.3
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
Tool use
JP
jpt 4b
Jpt · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
FL
biglove klein2
Flux · Granddyser
Params9.08B
Context—
Smallest6.5 GB
GGUF
FI
Fimbulvetr 11B v2
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
Vision
SE
weyaxi_seraph-7b
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
NeuralBeagle14 7B
Beagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
InkubaLM 0.4B
Inkubalm · QuantFactory
Params664M
Context2K
Q4_K_M0.4 GB
GGUF
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
GGUF
VE
MN 12B Vespa x1 i1
Vespa · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GGUF
GR
grimjim kunoichi lemon royale 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AT
Athena v3
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Moistral 11B v3
Moistral · BeaverLegacy
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing