Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
models--mergekit-community--mergekit-slerp-npojgos
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Sci-fi-vy
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
jisukim8873 mistral 7B alpaca case 1 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
vagosolutions_sauerkrautlm-7b-v1-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · second-state
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
OpenChat 3.5 7B Mixtral v2.0
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-dafvhck
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2506
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
Mahou-1.2b-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Mistral Small 3.1 24B Base 2503 Hf DanChat
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Evolved 11b v0.1
Mistral · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rfdxiqs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral 3 8B Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
GGUF
MI
ehartford_samantha-mistral-instruct-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
mistral orpo alpha
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
starmpcc Asclepius Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Snorkel Mistral PairRM DPO ExPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2 ko Y24 v2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
GGUF
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
Mistralai Mistral Nemo Instruct 2407 Extensive BP Abliteration 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use

Keep browsing