Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct Uz
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
HuggingFaceH4 mistral 7b anthropic
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes 2 Pro Mistral 7B GodCoder
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Candle Mistral 7B OpenOrca
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
cgato_thespis-mistral-7b-v0.6
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz2048 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fwizzer R1 3B EN v2
Mistral · fwizzer1
Params3.43B
Context256K
Smallest2.1 GB
CodingReasoningTool use
MI
Mistral 7B Instruct v0.3 Jbliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Helcyon 4o
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · crusoeai
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
Models Mistralai Ministral 8B Instruct 2410
Mistral · MaziyarPanahi
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.8 mistral 7b v02 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral-7B-Instruct-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Timestral-209M
Mistral · EvoAwaken-Workshop
Params209M
Context—
Smallest0.8 GB
GGUF
MI
Speechless Mistral Hermes Code 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral 7B Instruct v0.2 abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct ORPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
notus 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin mistral 24b venice edition literotica
Mistral · alexnt2
Params23.6B
Context128K
Smallest19.3 GB
Tool useVision
MI
Ministral 3 14B lil logbook
Mistral · thestarfarer
Params13.5B
Context256K
Smallest14.4 GB
RoleplayTool use
MI
Ministral 3 14B Base 2512 Chatml
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool useVision
MI
SherlockAssistant Mistral 7B Instruct Ukrainian
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
arcee ai Mistral 7B Instruct v0.2 sliced 24 layer
Mistral · RichardErkhov
Params5.5B
Context32K
Q4_K_M3.3 GB
GGUF
MI
Mistral Nemo 12b Neuro v3
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Openbuddy Mistral2 7b v20.3 32k
Mistral · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing