Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Kant-Test-0.1-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Sandbagging Cb New
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI DeepMedicalMind
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Devstral Small 2505
Mistral · mistralai
Params23.6B
Context128K
Smallest13.4 GB
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
openbuddy_openbuddy-mistral-7b-v13.1
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
MI
Young Children Storyteller Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409
Mistral · DavidAU
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Flirty Mistral
Mistral · mradermacher
Params7.3B
Context32K
Q4_K_M4.4 GB
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 14B Instruct 2512 BF16
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M8.8 GB
MI
Hermes-2-Pro-Mistral-7B-infinity
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x22B v0.1
Mistral · LiteLLMs
Params141B
Context64K
Q4_K_M85.6 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
T3Q Mistral Orca Math DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
ANIMA Cognitive Mistral v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2506
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
NousResearch DeepHermes 3 Mistral 24B Preview
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
macadeliccc_laser-dolphin-mixtral-2x7b-dpo
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mixtral AI CyberUltron DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Scary Story Finetune
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
jphme_em_german_mistral_v01
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
MI
Pixtral
Mistral · EnlistedGhost
Params12.2B
Context1000K
Q4_K_M7.7 GB