Richarderkhov GGUF models

77 GGUF models in the Richarderkhov family, quantized by 1 uploader. Sizes run from 31M to 34.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
K2S3 14b v0.2
Richarderkhov · RichardErkhov
Params14.4B
Context32K
Q4_K_M8.6 GB
GGUF
RI
2A2I R L1000MT
Richarderkhov · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
Yi Ko F v1
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
ME 7B v1.0
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
2A2I R L500MT
Richarderkhov · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RI
rm_1016_20K_lr_1e5
Richarderkhov · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RI
rm_1016_60K_lr_1e5
Richarderkhov · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RI
Q2H10M-0000
Richarderkhov · RichardErkhov
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
RI
Q15H10M-0000
Richarderkhov · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
RI
124M 0.5
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
Rm_1013
Richarderkhov · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
RI
M03H10M-0000
Richarderkhov · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RI
ME 7B v1.1
Richarderkhov · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Ge1H10M-0000
Richarderkhov · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
RI
wu981526092 MK4
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
Cp2024
Richarderkhov · RichardErkhov
Params31M
Context512
Q4_K_M0.0 GB
GGUF
RI
124M 0.4
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MK12
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MK8
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MK11
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
wu981526092 MP10
Richarderkhov · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
2A2I R L200MT
Richarderkhov · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RI
Hf Ar 107000
Richarderkhov · RichardErkhov
Params1.46B
Context2K
Q4_K_M1.0 GB
GGUF
RI
Yi Ko 1.2
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF

Keep browsing