Calme GGUF models

104 GGUF models in the Calme family, quantized by 12 uploaders. Sizes run from 3.09B to 78B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CA
Calme 7B Instruct v0.1
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
CA
calme-3.2-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
calme-3.2-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
CA
Calme Ties 78B i1
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
Calme-7B-Instruct-v0.2
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.2-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
Calme-7B-Instruct-v0.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
CA
Calme v6
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
CA
Calme-7B-Instruct-v0.4
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.3-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
Calme-7B-Instruct-v0.3
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.1-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
CA
Calme-7B-Instruct-v0.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
CA
Calme-4x7B-MoE-v0.1
Calme · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CA
Calme-7B-Instruct-v0.1.1
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-2.3-legalkit-8b
Calme · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
calme-3.1-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
CA
Calme-4x7B-MoE-v0.2
Calme · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CA
MaziyarPanahi/Calme-7B-Instruct-v0.9
Calme · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.3-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
calme-3.2-instruct-78b
Calme · DevQuasar-5
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
CA
Calme-7B-Instruct-v0.2
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-7B-Instruct-v0.5
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-7B-Instruct-v0.3
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
MaziyarPanahi/calme-2.3-legalkit-8b
Calme · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CA
calme-3.1-instruct-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
Calme-7B-Instruct-v0.9
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-4x7B-MoE-v0.2
Calme · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CA
calme-2.2-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
calme-3.1-baguette-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF

Keep browsing