Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
mergekit slerp kvkcnhb i1
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ME
Mergekit Slerp Xbklfzn
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
ME
mergekit community final test 2 original recipe
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit task arithmetic qjeuqjw i1
Mergekit · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ME
Mergekit Model_Stock Qtseiad
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit community final test 4 original old recipe
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit community mergekit ties knfdutf
Mergekit · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Mergekit Dare_Ties Twfgema
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit community mergekit della linear iwescit
Mergekit · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
ME
mergekit community mergekit slerp ocvgfla
Mergekit · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
ME
mergekit community mergekit ties hqqzvmi
Mergekit · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
ME
mergekit community grok 13b chat
Mergekit · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
Mergekit Dare_Ties Tpraytl
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
ME
mergekit-community/mergekit-passthrough-lkwyfft
Mergekit · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ME
mergekit community test 4 smarts plz b ablit
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community L3 Boshima a
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit ties hhvtkog
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit linear qtqmpco
Mergekit · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
ME
mergekit community mergekit ties noosmpy
Mergekit · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
ME
mergekit community mergekit task arithmetic fyizkfk
Mergekit · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
mergekit-community/mergekit-slerp-crxrtap
Mergekit · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ME
mergekit community mergekit slerp hayztti
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit model stock kkqblcl
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit ties vjlpsxw
Mergekit · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mergekit community final test 4 original old recipe humanish base
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit dare linear mawqtuj
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit slerp fmrazcr
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit model stock ysywggg
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community Deutscher Pantheon 12B
Mergekit · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit community mergekit ties liyosfu
Mergekit · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing