Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
mergekit community mergekit ties ndciole
Mergekit · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mergekit community Moist Theia 21B
Mergekit · RichardErkhov
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
ME
mergekit della linear sxmadrj
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Mergekit Dare_Ties Neobneo
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
ME
mergekit community final test 3 original recipe more reasoning
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ME
mergekit community final test 4 v3 original old recipe humanish base
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit passthrough bpksizv
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
ME
Mergekit Sce Sudfgqi
Mergekit · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
ME
mergekit community L3.1 Artemis d 8B
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community test 4 smarts
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit model stock tiwlqms
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit community mergekit della linear nimxtnw
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit della linear sxmadrj i1
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit community mergekit slerp lxmmvuv
Mergekit · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
Tool use
ME
Mergekit Passthrough Hdctkvu
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit community mergekit model stock tetlejm
Mergekit · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
mergekit community mergekit ties svidyqt
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit task arithmetic qjeuqjw
Mergekit · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ME
mergekit slerp xlblwaw
Mergekit · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ME
mergekit community nerp slerp nsfw
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
Mergekit Dare_Ties Mgtzoms
Mergekit · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
ME
mergekit model stock rxbbxes
Mergekit · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit sce osbthfy
Mergekit · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
ME
Yi Magnum Smaug 34b Q4 K M
Mergekit · SzilviaB
Params34.4B
Context4K
Q4_K_M41.3 GB
GGUF
ME
mergekit-community/L3.1-Artemis-c-8B
Mergekit · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit ties hecuvov
Mergekit · RichardErkhov
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
ME
mergekit-community/L3-Boshima-a
Mergekit · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Fischerboot/mergekit-slerp-awrvish
Mergekit · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit della linear dbwwdyo
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing