Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
mergekit dare ties ajgjgea Q8 0
Mergekit · Xiaojian9992024
Params1.5B
Context128K
Smallest1.6 GB
Tool use
ME
mergekit passthrough owrmdht Q2 K
Mergekit · Hjgugugjhuhjggg
Params1.24B
Context128K
Smallest0.6 GB
Tool use
ME
mergekit passthrough jgairfu IQ3 M
Mergekit · fengpeisheng1
Params11.3B
Context32K
Smallest5.2 GB
GGUF
ME
mergekit slerp fecxcxs
Mergekit · tensorblock
Params22.7B
Context16K
Smallest8.4 GB
GGUF
ME
mergekit model stock ffibbcs IQ4 NL
Mergekit · DarwinAnim8or
Params2.61B
Context8K
Smallest1.6 GB
GGUF
ME
Mergekit Passthrough Wgcnsdl
Mergekit · seeingterra
Params15B
Context128K
Smallest10.7 GB
GGUF
ME
mergekit sce vjeombg Q8 0
Mergekit · win10
Params14.8B
Context128K
Smallest15.7 GB
GGUF
ME
Magnum Smaug 34b Q4 K M
Mergekit · SzilviaB
Params34.4B
Context32K
Q4_K_M41.3 GB
GGUF
ME
Mergekit Dare_Ties Ftxcrqn
Mergekit · MrDevolver
Params23.6B
Context32K
Smallest13.5 GB
GGUF
ME
mergekit linear ccvlbbk Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit ties rraxdhv Q3 K S
Mergekit · Xiaojian9992024
Params9.24B
Context8K
Smallest4.3 GB
GGUF
ME
mergekit model stock xxfcylq Q4 K M
Mergekit · Snqwii
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit slerp yilmnid Q4 K M
Mergekit · TheDrunkenSnail
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ME
mergekit slerp iskhcfu IQ4 NL
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit ties dbpokuq Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
GGUF
ME
Magnum Smaug 34b Q8 0
Mergekit · SzilviaB
Params34.4B
Context32K
Smallest36.5 GB
GGUF
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest22.2 GB
GGUF
ME
mergekit community dolphin hermes
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Mergekit Slerp Yrjhrws
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit ties dkhnzcn IQ4 XS
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest2.0 GB
Tool use
ME
Mergekit Dare_Ties Neobneo
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
ME
mergekit ties tzamfyy Q2 K
Mergekit · Hjgugugjhuhjggg
Params1.24B
Context128K
Smallest0.6 GB
GGUF
ME
Mergekit Ties Xcouunl
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
Smaug Magnum 34b Q5 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Smallest24.3 GB
GGUF
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest19.3 GB
GGUF
ME
mergekit ties tembqzx Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use
ME
Mergekit Dare_Ties Fikucxa
Mergekit · MrDevolver
Params23.6B
Context32K
Smallest13.5 GB
GGUF
ME
mergekit ties ahipcqm Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use
ME
mergekit passthrough sppyqor Q2 K
Mergekit · Hjgugugjhuhjggg
Params323M
Context128K
Smallest0.2 GB
GGUF
ME
mergekit ties uoehqyz Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use

Keep browsing