Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Pixtral
Mistral · ggml-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
kolibri-vikhr-mistral-0427
Mistral · Vikhrmodels
Params7.6B
Context32K
Q4_K_M4.6 GB
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
MI
mlabonne_neuralhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral-Small-4-119B-2603
Mistral · mudler
Params119B
Context1024K
Smallest52.9 GB
MI
nondzu_mistral-7b-instruct-v0.2-code-ft
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 4 119B Uncensored
Mistral · timteh673
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Mahou-1.3a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx2_MoE_13B
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Mistral Nemo Inst 2407 12B Thinking Uncensored HERETIC HI Claude Opus
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mahou-1.3c-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai_Ministral 3 14B Instruct 2512 BF16
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct Heretic
Mistral · saidutta69
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Voxtral Small 24B 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
dolphin 2.2.1 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
voxtral mini 4b realtime
Mistral · cstr
Params4.43B
Context—
Smallest2.5 GB
MI
Mistral Small 3.1 24B Instruct 2503 MAX NEO Imatrix
Mistral · DavidAU
Params23.6B
Context128K
Q4_K_M16.1 GB
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB