Mergekit GGUF models
221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.
ME
mergekit dare ties ajgjgea Q8 0
Mergekit · Xiaojian9992024
Params1.5B
Context128K
Smallest1.6 GB
ME
mergekit passthrough owrmdht Q2 K
Mergekit · Hjgugugjhuhjggg
Params1.24B
Context128K
Smallest0.6 GB
ME
mergekit passthrough jgairfu IQ3 M
Mergekit · fengpeisheng1
Params11.3B
Context32K
Smallest5.2 GB
ME
mergekit slerp fecxcxs
Mergekit · tensorblock
Params22.7B
Context16K
Smallest8.4 GB
ME
mergekit model stock ffibbcs IQ4 NL
Mergekit · DarwinAnim8or
Params2.61B
Context8K
Smallest1.6 GB
ME
Mergekit Passthrough Wgcnsdl
Mergekit · seeingterra
Params15B
Context128K
Smallest10.7 GB
ME
mergekit sce vjeombg Q8 0
Mergekit · win10
Params14.8B
Context128K
Smallest15.7 GB
ME
Magnum Smaug 34b Q4 K M
Mergekit · SzilviaB
Params34.4B
Context32K
Q4_K_M41.3 GB
ME
Mergekit Dare_Ties Ftxcrqn
Mergekit · MrDevolver
Params23.6B
Context32K
Smallest13.5 GB
ME
mergekit linear ccvlbbk Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
mergekit ties rraxdhv Q3 K S
Mergekit · Xiaojian9992024
Params9.24B
Context8K
Smallest4.3 GB
ME
mergekit model stock xxfcylq Q4 K M
Mergekit · Snqwii
Params12.2B
Context1000K
Q4_K_M7.5 GB
ME
mergekit slerp yilmnid Q4 K M
Mergekit · TheDrunkenSnail
Params7.24B
Context8K
Q4_K_M4.4 GB
ME
mergekit slerp iskhcfu IQ4 NL
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
ME
mergekit ties dbpokuq Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
ME
Magnum Smaug 34b Q8 0
Mergekit · SzilviaB
Params34.4B
Context32K
Smallest36.5 GB
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest22.2 GB
ME
mergekit community dolphin hermes
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Mergekit Slerp Yrjhrws
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
ME
mergekit ties dkhnzcn IQ4 XS
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest2.0 GB
ME
Mergekit Dare_Ties Neobneo
Mergekit · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ME
mergekit ties tzamfyy Q2 K
Mergekit · Hjgugugjhuhjggg
Params1.24B
Context128K
Smallest0.6 GB
ME
Mergekit Ties Xcouunl
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
ME
Smaug Magnum 34b Q5 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Smallest24.3 GB
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest19.3 GB
ME
mergekit ties tembqzx Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
ME
Mergekit Dare_Ties Fikucxa
Mergekit · MrDevolver
Params23.6B
Context32K
Smallest13.5 GB
ME
mergekit ties ahipcqm Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
ME
mergekit passthrough sppyqor Q2 K
Mergekit · Hjgugugjhuhjggg
Params323M
Context128K
Smallest0.2 GB
ME
mergekit ties uoehqyz Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB