Mergekit GGUF models

221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
mergekit community mergekit della linear cwuosuu
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit sce vzszowb Q5 K M
Mergekit · tofumagnate
Params23.6B
Context32K
Smallest16.8 GB
GGUF
ME
mergekit ties fzhowyi Q8 0
Mergekit · Tokerss
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
ME
mergekit linear mwacdwp Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
mergekit linear lkqspau Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Mergekit Ties Uzreyxm
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
Mergekit Ties Mmgxhmk
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
GGUF
ME
mergekit community L3.1 Pneuma 8B v1
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ME
mergekit community mergekit della linear vpjjtsa
Mergekit · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ME
mergekit community final test ArliAI RPMax guidance all versions plus top 3 models
Mergekit · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
Tool use
ME
mergekit slerp xwepacy Q4 K M
Mergekit · Hanuman2
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing