Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
models--mergekit-community--mergekit-slerp-npojgos
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Sci-fi-vy
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
jisukim8873 mistral 7B alpaca case 1 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
vagosolutions_sauerkrautlm-7b-v1-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · second-state
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
OpenChat 3.5 7B Mixtral v2.0
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-dafvhck
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2506
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Mahou-1.2b-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral Small 3.1 24B Base 2503 Hf DanChat
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Evolved 11b v0.1
Mistral · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
MI
models--mergekit-community--mergekit-slerp-rfdxiqs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
MI
ehartford_samantha-mistral-instruct-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
mistral orpo alpha
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
starmpcc Asclepius Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Snorkel Mistral PairRM DPO ExPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.2 ko Y24 v2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
voxtral 4b tts
Mistral · cstr
Params4B
Context—
Smallest2.4 GB
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistralai Mistral Nemo Instruct 2407 Extensive BP Abliteration 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB