Chat GGUF models

88 GGUF models in the Chat family, quantized by 31 uploaders. Sizes run from 121M to 65.3B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CH
chat model14 09 2024
Chat · Conv-MLOps
Params8.03B
Context128K
Smallest8.5 GB
GGUF
CH
Chat_Doctor
Chat · jason162868
Params8.03B
Context128K
Smallest8.5 GB
Tool use
CH
chat
Chat · calcuis
Params3.43B
Context2K
Smallest2.0 GB
GGUF
CH
13b chat 150ep f16
Chat · RadarSISA
Params13B
Context4K
Smallest26.0 GB
GGUF
CH
Ci 0_5B Chat
Chat · mradermacher
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
CH
Chat2DB SQL 7B
Chat · Aldaris
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
CH
chat huanhuan model
Chat · bearhuang
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
Chat Toxic 7gb 9
Chat · luckycanucky
Params8.03B
Context16K
Smallest5.7 GB
GGUF
CH
BasicQueries
Chat · Sansar-Karki
Params163M
Context1K
Smallest0.2 GB
GGUF
CH
chat model
Chat · Conv-MLOps
Params8.03B
Context128K
Smallest8.5 GB
GGUF
CH
chat finetuned2
Chat · skyengine83
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
CH
Chat Toxic 7gb
Chat · luckycanucky
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
chat_conv
Chat · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
CH
Chat_GPT 2
Chat · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CH
chat finetuned
Chat · skyengine83
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
CH
yi chat 6B
Chat · OllmOne
Params6.06B
Context4K
Smallest2.6 GB
GGUF
CH
chat smodel
Chat · tsss1
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
CH
Chat Toxic 7gb 6
Chat · luckycanucky
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
chat clf
Chat · Dang
Params7.62B
Context32K
Smallest4.4 GB
Tool use
CH
Ci 1_8B Chat
Chat · mradermacher
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
CH
Ci 7B Chat
Chat · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
CH
s chat bot
Chat · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CH
chat doctor q4
Chat · SatRag
Params4.63B
Context128K
Smallest3.4 GB
ReasoningTool use
CH
chat
Chat · kozhaaai
Params7.25B
Context32K
Smallest7.7 GB
GGUF
CH
chat model
Chat · deribv1t
Params8.03B
Context32K
Q4_K_M2.1 GB
Tool use
CH
chat quiz
Chat · aliekuhgd
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
ai chat
Chat · maheenbakhtyar
Params8.03B
Context128K
Smallest16.1 GB
GGUF
CH
Ci 4B Chat
Chat · mradermacher
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
CH
chat doctor
Chat · siyah1
Params3.21B
Context128K
Smallest3.4 GB
GGUF

Keep browsing