Calme GGUF models

104 GGUF models in the Calme family, quantized by 12 uploaders. Sizes run from 3.09B to 78B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
CA
Calme-7B-Instruct-v0.2
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-7B-Instruct-v0.5
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme Rity stock v0.1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-7B-Instruct-v0.4
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--mergekit-community--mergekit-slerp-exkkzvd
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-7B-Instruct-v0.1
Calme · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme-4x7B-MoE-v0.2
Calme · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
CA
Calme 3.2 fp16 i1
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
CS Calme Instruct 7b
Calme · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.2-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
CA
Calme-7B-Instruct-v0.9
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.2-instruct-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
calme-2.2-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
CA
calme-3.3-instruct-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
calme-3.2-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
CA
calme-2.3-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
Calme-7B-Instruct-v0.3
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.3-baguette-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CA
calme-3.1-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
CA
calme-3.2-baguette-3b
Calme · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
CA
Calme Ties3 78B i1
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
CA
CS Calme Instruct 7b i1
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme Instruct Extended
Calme · QuantFactory
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
CA
calme v6 i1
Calme · mradermacher
Params78B
Context32K
Smallest0.0 GB
GGUF
CA
Calme Instruct Extended i1
Calme · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
CA
calme-3.3-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
CA
CS Calme Instruct 7b
Calme · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.1-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
CA
ultima 1
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
CA
Calme Instruct Extended
Calme · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF

Keep browsing