GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
ST
StartLux Decision v1 9B
Startlux · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
JI
jina embeddings v5 omni nano retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
TH
Thanos 3B i1
Thanos · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
BR
Brunhilde 2x7b MOE DPO v.01.5
Brunhilde · mradermacher
Params12.9B
Context32K
Q4_K_M7.9 GB
XL
xLAM 2 1b Fc R
Xlam · Salesforce
Params1.54B
Context32K
Q4_K_M1.0 GB
IM
Juggernaut Z Image Fast
Image · RunDiffusion
Params6.15B
Context—
Q4_K_M5.2 GB
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Gemmasutra Pro 27B V1F
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
CH
Chronos Divergence 33B i1
Chronos · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
EC
Echidna-13b-v0.3
Echidna · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
JP
jpt 4b
Jpt · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
FL
biglove klein2
Flux · Granddyser
Params9.08B
Context—
Smallest6.5 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
SE
weyaxi_seraph-7b
Seraph · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
NeuralBeagle14 7B
Beagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InkubaLM 0.4B
Inkubalm · QuantFactory
Params664M
Context2K
Q4_K_M0.4 GB
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
VE
MN 12B Vespa x1 i1
Vespa · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GR
grimjim kunoichi lemon royale 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
AT
Athena v3
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Luminurse-v0.2-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MO
Moistral 11B v3
Moistral · BeaverLegacy
Params10.7B
Context8K
Q4_K_M6.5 GB
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB