Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
dolphin 2.6 mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI CyberLord
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 abliterated
Mistral · AliBilge
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
nousresearch_nous-hermes-2-mixtral-8x7b-sft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Base 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.1 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
juhwanlee llmdo Mistral 7B case 1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai_Devstral Small 2507
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
ANIMA Phi Neptune Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral v2 orpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
MistralMath 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT Wikihow
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cognitivecomputations dolphin 2.6 mistral 7b dpo laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 12B Thinking HI Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Codestral 22B v0.1
Mistral · QuantFactory
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral Small 24B Instruct 2501
Mistral · lmstudio-community
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral Large Instruct 2407
Mistral · second-state
Params123B
Context128K
Q4_K_M73.2 GB
MI
flammenai flammen16 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b beta Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.2 hf
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
MI
BASH Coder Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB