Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
Mergekit Ties Fttytxe
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
Mergekit Slerp Bdnrcnz
Mergekit · fengpeisheng1
Params7.24B
Context32K
Smallest4.1 GB
GGUF
ME
mergekit model stock injkqri Q8 0
Mergekit · win10
Params14.8B
Context986K
Smallest15.7 GB
Tool use
ME
mergekit passthrough zyecuzy Q5 K M
Mergekit · SzilviaB
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
ME
Smaug Magnum 34b Q3 K S
Mergekit · SzilviaB
Params34.4B
Context195K
Smallest15.0 GB
GGUF
ME
mergekit task arithmetic ujkciex Q4 K M
Mergekit · Skarmorie
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
mergekit slerp zgtiwgh IQ4 NL
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit linear ofwfskc Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Mergekit Ties Anywnpt
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
mergekit community test 4 smarts222
Mergekit · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Mergekit Dare_Ties Xejqqxa
Mergekit · MrDevolver
Params23.6B
Context32K
Smallest13.5 GB
GGUF
ME
mergekit ties bzyblbo Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use
ME
mergekit passthrough gobkudc Q4 K M
Mergekit · Taephom
Params11.3B
Context32K
Q4_K_M6.9 GB
GGUF
ME
mergekit slerp ejvpuvq Q6 K
Mergekit · Taephom
Params7.62B
Context32K
Smallest6.3 GB
GGUF
ME
Mergekit Slerp Icdiqka
Mergekit · fengpeisheng1
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mergekit model stock vkhniqh Q5 K M
Mergekit · SzilviaB
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
ME
Mergekit Slerp Nwlpuqj
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit slerp epibiuy Q3 K M
Mergekit · SzilviaB
Params34.4B
Context4K
Smallest16.7 GB
GGUF
ME
mergekit model stock ffibbcs IQ4 XS
Mergekit · DarwinAnim8or
Params2.61B
Context8K
Smallest1.6 GB
GGUF
ME
mergekit community SthenoLlamaStock
Mergekit · RichardErkhov
Params8.03B
Context8K
Smallest3.2 GB
GGUF
ME
mergekit slerp fmrazcr Q4 K M
Mergekit · jaspionjader
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ME
Mergekit Ties Eivdcuf
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
mergekit Q4 K M
Mergekit · anthonymeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
Mergekit Karcher Pifptpx
Mergekit · win10
Params8.03B
Context128K
Smallest8.5 GB
Tool use
ME
Mergekit Slerp Flivnff
Mergekit · fengpeisheng1
Params7.62B
Context32K
Smallest4.4 GB
GGUF
ME
mergekit linear mocebtg Q4 K M
Mergekit · SaisExperiments
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
ME
mergekit slerp sqglozs Q4 K M
Mergekit · SzilviaB
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ME
mergekit ties swkriqf Q2 K
Mergekit · Hjgugugjhuhjggg
Params3.61B
Context128K
Smallest1.5 GB
Tool use
ME
mergekit model stock czbocwb Q4 K M
Mergekit · tofumagnate
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
ME
mergekit linear pcuhyqy Q4 K M
Mergekit · SaisExperiments
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use

Keep browsing