Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
Mergekit Linear Iwfvdmg
Mergekit · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
ME
Mergekit Slerp Srinwor
Mergekit · mradermacher
Params10.1B
Context128K
Q4_K_M6.2 GB
GGUF
ME
mergekit community OpenO1Stheno
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit ties oysoxmc
Mergekit · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
mergekit model stock fpfjlqs
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit slerp xmcxsqe
Mergekit · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
GGUF
ME
mergekit v2
Mergekit · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
ME
mergekit slerp kvkcnhb
Mergekit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ME
mergekit slerp fqnakng Q5 K S
Mergekit · TheWhiteGamer
Params6.74B
Context16K
Smallest4.7 GB
GGUF
ME
mergekit model stock zengbax
Mergekit · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
DevilHermes
Mergekit · SzilviaB
Params7.24B
Context8K
Smallest7.7 GB
Tool use
ME
Mergekit Slerp Xbklfzn
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
ME
mergekit slerp fqnakng Q8 0
Mergekit · TheWhiteGamer
Params6.74B
Context16K
Smallest7.2 GB
GGUF
ME
Mergekit Slerp Hrippzo
Mergekit · fengpeisheng1
Params7.62B
Context128K
Smallest4.4 GB
Tool use
ME
Magnum Smaug 34b Q5 K M
Mergekit · SzilviaB
Params34.4B
Context32K
Smallest24.3 GB
GGUF
ME
Smaug Magnum 34b Q4 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Q4_K_M41.3 GB
GGUF
ME
mergekit slerp ariyvyf IQ4 NL
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit slerp fgoimpq IQ4 NL
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
240404 mergekit MoE chatntq ja 7b v1.0 shisa gamma 7b v1
Mergekit · shidowake
Params12.9B
Context4K
Q4_K_M7.8 GB
GGUF
ME
mergekit community mergekit ties pgelggu
Mergekit · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ME
mergekit community mergekit ties htjjeox
Mergekit · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
ME
mergekit community mergekit ties gxhsjzj
Mergekit · RichardErkhov
Params6.74B
Context4K
Smallest2.5 GB
GGUF
ME
mergekit ties dkhnzcn Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use
ME
Mergekit Slerp Ppehixi
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
Mergekit Slerp Wcnxrow
Mergekit · fengpeisheng1
Params7.24B
Context8K
Smallest4.1 GB
GGUF
ME
mergekit model stock ffibbcs Q4 K S
Mergekit · DarwinAnim8or
Params2.61B
Context8K
Smallest1.6 GB
GGUF
ME
Mergekit Slerp Bovhgyd
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit passthrough cijkogj Q2 K
Mergekit · Hjgugugjhuhjggg
Params889M
Context128K
Smallest0.5 GB
Tool use
ME
mergekit slerp zwbqvcb Q6 K
Mergekit · Taephom
Params7.62B
Context32K
Smallest6.3 GB
Tool use
ME
mergekit linear rfxmzdf Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use

Keep browsing