Chat GGUF models

88 GGUF models in the Chat family, quantized by 31 uploaders. Sizes run from 121M to 65.3B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CH
Chat Anything 3B
Chat · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CH
Chat With YourFAV Character Medium i1
Chat · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
CH
williamlcn/chat
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CH
K2-Chat
Chat · bartowski
Params65.3B
Context8K
Q4_K_M39.3 GB
GGUF
CH
Chat Titles 230M Merged
Chat · OleFranz
Params230M
Context125K
Q4_K_M0.2 GB
ReasoningTool use
CH
AR Chat v1.0
Chat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CH
ds chat reflection adamw iter1
Chat · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
CH
Chat KTO 4B
Chat · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
CH
LLM360.K2 Chat
Chat · DevQuasar
Params65.3B
Context8K
Q4_K_M39.3 GB
GGUF
CH
AR 1.7B Chat
Chat · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
ReasoningTool use
CH
AR 4B Chat
Chat · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
ReasoningTool use
CH
Chat_Gpt2
Chat · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
CH
Chat2DB SQL 7B
Chat · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
CH
AR 8B Chat
Chat · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
CH
Chat With YourFAV Character Medium
Chat · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
CH
Chat With YourFAV Character Small
Chat · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CH
ru chat 3b gguf q8
Chat · aiplatforms
Params3.09B
Context32K
Smallest3.3 GB
Tool use
CH
williamlcn/chat1
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CH
Chat Doctor
Chat · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
CH
7b chat 1ep f16
Chat · RadarSISA
Params6.74B
Context4K
Smallest13.5 GB
GGUF
CH
Chat Toxic 7gb 4
Chat · luckycanucky
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
AR 1.7B Chat
Chat · mradermacher
Params2.03B
Context32K
Q4_K_M1.3 GB
ReasoningTool use
CH
ru chat 3b gguf q4
Chat · aiplatforms
Params3.09B
Context32K
Smallest1.8 GB
Tool use
CH
ru chat 1.5b gguf q8
Chat · aiplatforms
Params1.54B
Context32K
Smallest1.6 GB
Tool use
CH
Ec Chat
Chat · jarvishacks
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
chat model 15 09 2024
Chat · Conv-MLOps
Params8.03B
Context128K
Smallest8.5 GB
GGUF
CH
justina clarus 24b
Chat · VirtuoTuring
Params23.6B
Context32K
Q4_K_M14.3 GB
Coding
CH
Chat Toxic 7gb 5
Chat · luckycanucky
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
chat doctor
Chat · SatRag
Params4.63B
Context128K
Smallest4.9 GB
ReasoningTool use
CH
Chat Toxic 7gb 8
Chat · luckycanucky
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing