Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nondzu Mistral 7B code 16k qlora
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Gigaberg Mistral Large 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Mistral portuguese luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B PairRM SPPO Iter3 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral SD v0.4
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Open_Hermes_Orca_Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
llava v1.6 mistral 7b Q5 K S
Mistral · ShadowBeast
Params7.24B
Context32K
Smallest5.0 GB
Vision
MI
mistral 7b sft beta i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.5 mixtral 8x7b
Mistral · tsunemoto
Params46.7B
Context32K
Q4_K_M26.3 GB
GGUF
MI
openchat 3.5 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · mradermacher
Params593M
Context32K
Q4_K_M0.5 GB
GGUF
MI
CleverBoi 7B v3
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral ft optimized 1218
Mistral · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Ppo C Hermes
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral magnum v4 X Cydonia VXXX Max i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
mistral nemo gutenberg 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
nbeerbower mistral nemo bophades 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Trinity 2 Codestral 22B v0.2 i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Mistral 7B v0.2 OpenHermes
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Holodeck v1
Mistral · KoboldAI
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Hercules 1.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Toxic Chimera Mistral 24B P1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AVA Mistral 7B V2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Uncensored_Mistral 7B_v0.3_Seaftensors GGUF
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing