Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
dongyru Mistral 7B Claim Extractor
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1 turkish
Mistral · sayhan
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Juud Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Drummer 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Dionysus Mistral M3 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Moderne 12B FFT experimental
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
internlm2-math-plus-mixtral8x22b
Mistral · lmstudio-community
Params141B
Context64K
Q4_K_M85.6 GB
MI
Mistral 7B Merge 02 v0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DoppelKartoffel Mistral Nemo 23B i1
Mistral · mradermacher
Params23.2B
Context1000K
Q4_K_M14.0 GB
MI
Mixtral v0.1 8x7B Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
cognitivecomputations dolphin 2.2.1 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler inverse sqrt dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 Heretic Noslop MPOA
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B CrewAI
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3
Mistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.3 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · therummage
Params23.6B
Context128K
Smallest25.1 GB
MI
Huihui ai.Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mistral nemo gutenberg 12B v3
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
bineric NorskGPT Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral_Pro_8B_v0.1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
MI
ziniuli/Mistral-7B-ReMax-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Cognitive Mistral v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
T3Q Platypus MistralM7 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
malaysian-mistral-7b-32k-instructions
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
merlinite 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Character Creator V2
Mistral · SufficientPrune3897
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB