Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 50 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Kurdish Instruct
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
bagel 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo narwhal 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Karen TheEditor V2 STRICT Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistralai.Mistral Small 24B Instruct 2501
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mlfoundations dev mistral alpaca sft sample 5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammen13X mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sania963 Mistral instruct sql v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B v0.2 Meditron Turkish
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Japanese Instruct 2408
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
InnerI InnerILLM OpenPipe Nous Yarn Mistral optimized 1228 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Moriacrafter Mistral 7B v0.2 none DepressionDetection Reddit
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Abliterated Obliteratus
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
EleutherAI Mistral 7B v0.1 population first ft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · DevQuasar-11
Params593M
Context32K
Q4_K_M0.5 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Yarn-Mistral-7b-128k-DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid 7b v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Luau Devstral 24B Instruct v0.1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Hermes2 Gutenberg2 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral 3 14B DeLERP 0.5 Instruct
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · backyardai
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Inst 0.2 Bulleted Notes
Mistral · cognitivetech
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1 iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
NeuralHermes 2.5 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
speechless mistral dolphin orca platypus samantha 7b dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing