Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
loyal piano m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Spellbound StoryWriter 22B instruct 0.2 chkpt 200 16 bit i1
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
MI
Mistral Crab SFT
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501 reasoning
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
bellman 7b mistral instruct v0.2
Mistral · neph1
Params7.24B
Context32K
Smallest3.5 GB
GGUF
MI
PVD 160k Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B-PairRM-SPPO-Iter3
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI CyberTron DeepMind II
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
mathstral-7B-v0.1
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo cc 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
distilabeled OpenHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mathstral-7B-v0.1
Mistral · second-state
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Evolved Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Instruct 2407 Heretic Noslop
Mistral · noctrex
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B ReMax v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral nemo ja rp v0.2
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
RoleplayTool use
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MistralCreative 24B Chat i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Bangla Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hebrew Mistral 7B
Mistral · QuantFactory
Params7.5B
Context32K
Q4_K_M4.6 GB
GGUF
MI
Mistral 7B v0.2 Meditron Turkish
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha mistral instruct 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
gqd mistral merge 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nbeerbower Lyra Gutenberg mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 8x22B v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Codestral-22B-v0.1
Mistral · CISCai
Params22.2B
Context32K
Smallest4.8 GB
CodingTool use

Keep browsing