Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
mistralai_mistral-7b-v0.1
Mistral · proetektor8
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Sandbagging Cb
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Astronomy 7b v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin mistral TRACHI 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 flashback v2 instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Astronomy 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Microscopic-Mistral-120k-steps
Mistral · mradermacher
Params811M
Context512
Q4_K_M0.5 GB
MI
Mistral 7b v0.1 Layla v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Instruct Ukrainian slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Leanstral 1.5 119B A6B
Mistral · Abu-Dju
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Moriacrafter Mistral 7B v0.2 4bit DepressionDetection Reddit
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 Arabic
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mamba Codestral 7B v0.1 python coding assistant GGUF 8bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest7.7 GB
MI
mistral v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7b v0.1 Dpo
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Openbuddy Mixtral 8x7b v15.4
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.5 GB
MI
Pearl 7B Slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Code Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Sentiment Analysis 7B imatrix
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Precog 24B V1B Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
osanseviero mistral instruct moe experimental
Mistral · RichardErkhov
Params13B
Context32K
Q4_K_M7.8 GB
MI
Tamil Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.39B
Context32K
Q4_K_M4.5 GB
MI
nilq baby python mistral 1L tiny lua ft
Mistral · RichardErkhov
Params35M
Context2K
Q4_K_M0.0 GB
MI
mistral-7B-test-v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Speechless Instruct Mistral 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
philosophy mistral
Mistral · Heralax
Params7.24B
Context32K
Smallest7.7 GB
MI
Tiamat 24B Magistral
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB