Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7b Portuguese V0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chihoonlee10/T3Q-EN-DPO-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI Cyber 5.0 SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
OpenHermesV2 PTBR portuguese brazil
Mistral · BornSaint
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-7b-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3
Mistral · DuoNeural
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistralai.Mistral Large 3 675B Instruct 2512 BF16
Mistral · DevQuasar
Params673B
Context288K
Q4_K_M405.8 GB
MI
Oumuamua-7b-instruct-v2
Mistral · bartowski
Params7.33B
Context32K
Q4_K_M4.9 GB
MI
OpenLLM France.Claire Mistral 7B 0.1
Mistral · DevQuasar-9
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Punisher Carnage V2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Nexus IKM Mistral 7B MLX
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
e5 mistral 7b instruct
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AZERG T2 Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 4B FT 2
Mistral · RichardErkhov
Params3.75B
Context32K
Q4_K_M2.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · AI-Engine
Params12.2B
Context1000K
Smallest4.8 GB
MI
mncai_mistral-7b-dpo-v5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cognitivecomputations dolphin 2.8 mistral 7b v02
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zubr mini 1.8 3b
Mistral · alekringtonnn-ai
Params3.43B
Context32K
Smallest1.4 GB
MI
Medilora Mistral 7B
Mistral · Medilora
Params7.24B
Context32K
Smallest3.8 GB
MI
Mistral 7B v0.1 Adv
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Writing_Partner_Mistral_7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-v0.1-OKI-v20231124-1e-5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params22.6B
Context1000K
Q4_K_M13.7 GB
MI
mistral 7b legal lora
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b v0.1 Layla v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mlx Community Mistral Small 3.2 24B Instruct 2506 Bf16
Mistral · tensorblock
Params23.6B
Context128K
Smallest8.9 GB
MI
Frostwind Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
flammenai flammen18X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KoboldAI/Mistral-7B-Holodeck-1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Harmful
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB