Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7b Portuguese V0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
chihoonlee10/T3Q-EN-DPO-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI Cyber 5.0 SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
OpenHermesV2 PTBR portuguese brazil
Mistral · BornSaint
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral-7b-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · DuoNeural
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistralai.Mistral Large 3 675B Instruct 2512 BF16
Mistral · DevQuasar
Params673B
Context288K
Q4_K_M405.8 GB
Tool useVision
MI
Oumuamua-7b-instruct-v2
Mistral · bartowski
Params7.33B
Context32K
Q4_K_M4.9 GB
Roleplay
MI
OpenLLM France.Claire Mistral 7B 0.1
Mistral · DevQuasar-9
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Punisher Carnage V2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Nexus IKM Mistral 7B MLX
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
e5 mistral 7b instruct
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
AZERG T2 Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 4B FT 2
Mistral · RichardErkhov
Params3.75B
Context32K
Q4_K_M2.3 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · AI-Engine
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
MI
mncai_mistral-7b-dpo-v5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cognitivecomputations dolphin 2.8 mistral 7b v02
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zubr mini 1.8 3b
Mistral · alekringtonnn-ai
Params3.43B
Context32K
Smallest1.4 GB
Tool use
MI
Medilora Mistral 7B
Mistral · Medilora
Params7.24B
Context32K
Smallest3.8 GB
GGUF
MI
Mistral 7B v0.1 Adv
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Writing_Partner_Mistral_7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-v0.1-OKI-v20231124-1e-5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params22.6B
Context1000K
Q4_K_M13.7 GB
Tool use
MI
mistral 7b legal lora
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b v0.1 Layla v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mlx Community Mistral Small 3.2 24B Instruct 2506 Bf16
Mistral · tensorblock
Params23.6B
Context128K
Smallest8.9 GB
GGUF
MI
Frostwind Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
flammenai flammen18X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KoboldAI/Mistral-7B-Holodeck-1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3 Harmful
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use

Keep browsing