Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B Instruct Uz
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
HuggingFaceH4 mistral 7b anthropic
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes 2 Pro Mistral 7B GodCoder
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Candle Mistral 7B OpenOrca
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
cgato_thespis-mistral-7b-v0.6
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz2048 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fwizzer R1 3B EN v2
Mistral · fwizzer1
Params3.43B
Context256K
Smallest2.1 GB
MI
Mistral 7B Instruct v0.3 Jbliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Helcyon 4o
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · crusoeai
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Models Mistralai Ministral 8B Instruct 2410
Mistral · MaziyarPanahi
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.8 mistral 7b v02 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Timestral-209M
Mistral · EvoAwaken-Workshop
Params209M
Context—
Smallest0.8 GB
MI
Speechless Mistral Hermes Code 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct ORPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
notus 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin mistral 24b venice edition literotica
Mistral · alexnt2
Params23.6B
Context128K
Smallest19.3 GB
MI
Ministral 3 14B lil logbook
Mistral · thestarfarer
Params13.5B
Context256K
Smallest14.4 GB
MI
Ministral 3 14B Base 2512 Chatml
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
SherlockAssistant Mistral 7B Instruct Ukrainian
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
arcee ai Mistral 7B Instruct v0.2 sliced 24 layer
Mistral · RichardErkhov
Params5.5B
Context32K
Q4_K_M3.3 GB
MI
Mistral Nemo 12b Neuro v3
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Openbuddy Mistral2 7b v20.3 32k
Mistral · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB