Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistral-11b-slimorca
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Kabster Bio Mistralv2 Squared
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Wayfarer-2-12B
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.9 GB
Roleplay
MI
Mistral 7B Instruct v0.3 Malevolent
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
s3nh nsfw noromaid mistral instruct
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx2_MoE_13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Hemispheres 7B Right
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
MiaLatte Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Behemoth X 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Mistral Grand R1 Dolphin 3.0 Deep Reasoning Brainstorm 45B i1
Mistral · mradermacher
Params45.2B
Context32K
Q4_K_M27.4 GB
Reasoning
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
openinstruct-mistral-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.9.1 mistral 22b i1
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
atom v1 preview 8b
Mistral · vanta-research
Params8.02B
Context32K
Smallest4.7 GB
ReasoningTool use
MI
Bitnet-Mistral.0.2-330m-v0.2-grokfast-v2.9
Mistral · BoscoTheDog
Params330M
Context4K
Q4_K_M0.2 GB
GGUF
MI
UNA-dolphin-2.6-mistral-7b-dpo-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Mistral 7B 32k i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Reasoning Mistral Nemo
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
MI
Mistral Small 2501 SCE Mashup 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch1 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
ReasoningTool use
MI
Ministral 3 8B Animus V12.0
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
RoleplayTool use
MI
mlfoundations dev hp ablations grid mistral bsz1024 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing