GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
BL
bloom 3b conversational
Bloom · duyntnet
Params3.64B
Context3K
Q4_K_M2.4 GB
GGUF
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EM
Emollama chat 7b imatrix
Emollama · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
NO
notus-7b-v1
Notus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous Hermes 13b imatrix
Nous · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
Tool use

Keep browsing