Chat GGUF models
88 GGUF models in the Chat family, quantized by 31 uploaders. Sizes run from 121M to 65.3B parameters. The longest trained context is 256K tokens.
CH
Chat Anything 3B
Chat · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CH
Chat With YourFAV Character Medium i1
Chat · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
CH
williamlcn/chat
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
K2-Chat
Chat · bartowski
Params65.3B
Context8K
Q4_K_M39.3 GB
CH
Chat Titles 230M Merged
Chat · OleFranz
Params230M
Context125K
Q4_K_M0.2 GB
CH
AR Chat v1.0
Chat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
ds chat reflection adamw iter1
Chat · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
CH
Chat KTO 4B
Chat · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
CH
LLM360.K2 Chat
Chat · DevQuasar
Params65.3B
Context8K
Q4_K_M39.3 GB
CH
AR 1.7B Chat
Chat · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
CH
AR 4B Chat
Chat · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
CH
Chat_Gpt2
Chat · tensorblock
Params163M
Context1K
Smallest0.1 GB
CH
Chat2DB SQL 7B
Chat · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
CH
AR 8B Chat
Chat · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
CH
Chat With YourFAV Character Medium
Chat · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
CH
Chat With YourFAV Character Small
Chat · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
CH
ru chat 3b gguf q8
Chat · aiplatforms
Params3.09B
Context32K
Smallest3.3 GB
CH
williamlcn/chat1
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
Chat Doctor
Chat · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
CH
7b chat 1ep f16
Chat · RadarSISA
Params6.74B
Context4K
Smallest13.5 GB
CH
Chat Toxic 7gb 4
Chat · luckycanucky
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
AR 1.7B Chat
Chat · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
CH
ru chat 3b gguf q4
Chat · aiplatforms
Params3.09B
Context32K
Smallest1.8 GB
CH
ru chat 1.5b gguf q8
Chat · aiplatforms
Params1.54B
Context32K
Smallest1.6 GB
CH
Ec Chat
Chat · jarvishacks
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
chat model 15 09 2024
Chat · Conv-MLOps
Params8.03B
Context128K
Smallest8.5 GB
CH
justina clarus 24b
Chat · VirtuoTuring
Params23.6B
Context32K
Q4_K_M14.3 GB
CH
Chat Toxic 7gb 5
Chat · luckycanucky
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
chat doctor
Chat · SatRag
Params4.63B
Context128K
Smallest4.9 GB
CH
Chat Toxic 7gb 8
Chat · luckycanucky
Params8.03B
Context128K
Q4_K_M4.9 GB