Richarderkhov GGUF models

77 GGUF models in the Richarderkhov family, quantized by 1 uploader. Sizes run from 31M to 34.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
RI
124M 0.0
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
774M-03_09_2024
Richarderkhov · RichardErkhov
Params770M
Context1K
Q4_K_M0.5 GB
GGUF
RI
107gc1k
Richarderkhov · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RI
wu981526092 MK5
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
Hf Ar 134000
Richarderkhov · RichardErkhov
Params1.46B
Context2K
Q4_K_M1.0 GB
GGUF
RI
wu981526092 MK10
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
C2_T2_16
Richarderkhov · RichardErkhov
Params6.72B
Context128K
Q4_K_M4.1 GB
GGUF
RI
DR 8 5 M V1
Richarderkhov · RichardErkhov
Params8.03B
Context128K
Smallest3.2 GB
GGUF
RI
124M 0.6
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
rm_1016_40K_lr_1e5
Richarderkhov · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RI
wu981526092 MK7
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MK3
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MK6
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
M7 7b
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
wu981526092 MK9
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
124M 0.3
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing