Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nondzu Mistral 7B code 16k qlora
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Gigaberg Mistral Large 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
Mistral portuguese luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral7B PairRM SPPO Iter3 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral SD v0.4
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Open_Hermes_Orca_Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llava v1.6 mistral 7b Q5 K S
Mistral · ShadowBeast
Params7.24B
Context32K
Smallest5.0 GB
MI
mistral 7b sft beta i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.5 mixtral 8x7b
Mistral · tsunemoto
Params46.7B
Context32K
Q4_K_M26.3 GB
MI
openchat 3.5 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 DRAFT 0.5B
Mistral · mradermacher
Params593M
Context32K
Q4_K_M0.5 GB
MI
CleverBoi 7B v3
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1218
Mistral · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Ppo C Hermes
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral magnum v4 X Cydonia VXXX Max i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
mistral nemo gutenberg 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
nbeerbower mistral nemo bophades 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Trinity 2 Codestral 22B v0.2 i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral 7B v0.2 OpenHermes
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Holodeck v1
Mistral · KoboldAI
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Hercules 1.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Toxic Chimera Mistral 24B P1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AVA Mistral 7B V2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Uncensored_Mistral 7B_v0.3_Seaftensors GGUF
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB