Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
loyal piano m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Spellbound StoryWriter 22B instruct 0.2 chkpt 200 16 bit i1
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Mistral Crab SFT
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 reasoning
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
bellman 7b mistral instruct v0.2
Mistral · neph1
Params7.24B
Context32K
Smallest3.5 GB
MI
PVD 160k Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral7B-PairRM-SPPO-Iter3
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI CyberTron DeepMind II
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral-7B-v0.1
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo cc 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
distilabeled OpenHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral-7B-v0.1
Mistral · second-state
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Evolved Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 Heretic Noslop
Mistral · noctrex
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B ReMax v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral nemo ja rp v0.2
Mistral · ascktgcc
Params12.2B
Context1000K
Smallest7.1 GB
MI
Prox-MistralHermes-7B
Mistral · Mungert
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralCreative 24B Chat i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Bangla Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hebrew Mistral 7B
Mistral · QuantFactory
Params7.5B
Context32K
Q4_K_M4.6 GB
MI
Mistral 7B v0.2 Meditron Turkish
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha mistral instruct 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
gqd mistral merge 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nbeerbower Lyra Gutenberg mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mixtral 8x22B v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Codestral-22B-v0.1
Mistral · CISCai
Params22.2B
Context32K
Smallest4.8 GB