Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistralai_mistral-7b-v0.1
Mistral · proetektor8
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Sandbagging Cb
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Astronomy 7b v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin mistral TRACHI 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 flashback v2 instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Astronomy 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Microscopic-Mistral-120k-steps
Mistral · mradermacher
Params811M
Context512
Q4_K_M0.5 GB
GGUF
MI
Mistral 7b v0.1 Layla v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Instruct Ukrainian slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Leanstral 1.5 119B A6B
Mistral · Abu-Dju
Params119B
Context1024K
Q4_K_M72.2 GB
Tool useVision
MI
Moriacrafter Mistral 7B v0.2 4bit DepressionDetection Reddit
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 Arabic
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mamba Codestral 7B v0.1 python coding assistant GGUF 8bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest7.7 GB
Coding
MI
mistral v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7b v0.1 Dpo
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Openbuddy Mixtral 8x7b v15.4
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.5 GB
GGUF
MI
Pearl 7B Slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Code Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Sentiment Analysis 7B imatrix
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Precog 24B V1B Workspace
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
osanseviero mistral instruct moe experimental
Mistral · RichardErkhov
Params13B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Tamil Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.39B
Context32K
Q4_K_M4.5 GB
GGUF
MI
nilq baby python mistral 1L tiny lua ft
Mistral · RichardErkhov
Params35M
Context2K
Q4_K_M0.0 GB
GGUF
MI
mistral-7B-test-v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Speechless Instruct Mistral 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
philosophy mistral
Mistral · Heralax
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Tiamat 24B Magistral
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use

Keep browsing