Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
Mistral-7B-Instruct-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
allura org.Mistral Small 24b Sertraline 0304
Mistral · csabakecskemeti
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mixtral 8x7B v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B Instruct DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
GGUF
MI
Devstral Small 2507
Mistral · gabriellarson
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool useVision
MI
Ministral 8B Instruct 2410 Sft
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
CodingTool use
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
MI
Breezeblossom v4 mistral 2x7B i1
Mistral · mradermacher
Params13.1B
Context32K
Q4_K_M8.0 GB
GGUF
MI
Mixtral AI Cyber 3.1 SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Dans PersonalityEngine V1.1.0 12b
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
MI
Shisa v2 Mistral Nemo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · legraphista
Params12.2B
Context1000K
Smallest3.0 GB
GGUF
MI
Mistral 8B IMDB Merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Pixtral
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Hebrew Mistral 7B 200K
Mistral · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral portuguese luana 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Instruct 2409 Abliterated
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningTool use
MI
Mistral Nemo Instruct Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use

Keep browsing