Mergekit GGUF models
221 GGUF models in the Mergekit family, quantized by 28 uploaders. Sizes run from 323M to 34.4B parameters. The longest trained context is 1000K tokens.
ME
mergekit community mergekit della linear cwuosuu
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
mergekit sce vzszowb Q5 K M
Mergekit · tofumagnate
Params23.6B
Context32K
Smallest16.8 GB
ME
mergekit ties fzhowyi Q8 0
Mergekit · Tokerss
Params12.2B
Context1000K
Smallest13.0 GB
ME
mergekit linear mwacdwp Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
mergekit linear lkqspau Q4 K M
Mergekit · MrDevolver
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
Mergekit Ties Uzreyxm
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
ME
Mergekit Ties Mmgxhmk
Mergekit · Culturedniichan
Params23.6B
Context32K
Smallest11.5 GB
ME
mergekit community L3.1 Pneuma 8B v1
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
mergekit community mergekit della linear vpjjtsa
Mergekit · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ME
mergekit community final test ArliAI RPMax guidance all versions plus top 3 models
Mergekit · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
ME
mergekit slerp xwepacy Q4 K M
Mergekit · Hanuman2
Params7.24B
Context32K
Q4_K_M4.4 GB