Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistral 7b cthulhu
Mistral · theprint
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid v0.1 mixtral 8x7b Instruct v3
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 8bit Abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Code Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Roleplay V6
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
Mistral 7B Alpaca 52k v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DanatAI Mixtral 07B Instruct ipos
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Sft Beta Rm Mistral Sft Temp07 Lr 5e7 Iter1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
vigostral 7b chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
JJhooww Mistral 7B v0.2 Instruction
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammen18X mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mistral Small 24B Instruct 2501
Mistral · DevQuasar-8
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
mistral 7b bnb 4bit homeassistant
Mistral · BramNH
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral v0.3 Instruct Matter Slim A
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Storywriter 12b 241015
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Oh Mistral bs4096_lr2_00E 06_schedulerconstant_warmup5_00E 02_minlr
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WEBGEN Devstral 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
mistral 7b grok
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Docsgpt 7b Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b slimorcaboros Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr8e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralThinker v1.1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplay
MI
Dolphin Mistral 24B Venice Edition Exl2 6bpw
Mistral · kozynthetaquito
Params13M
Context32K
Q4_K_M0.0 GB
GGUF
MI
Oh Mistral bs4096_lr2_00E 06_schedulerconstant_warmup1_00E 01_minlr
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral CyberLawyer 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF

Keep browsing