GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
BL
bloom 3b conversational
Bloom · duyntnet
Params3.64B
Context3K
Q4_K_M2.4 GB
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
EM
Emollama chat 7b imatrix
Emollama · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
NO
notus-7b-v1
Notus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous Hermes 13b imatrix
Nous · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB