Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Smut_Mistral_7B02_V0_Merged
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NousResearch Nous Hermes 2 Mistral 7B DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
HuggingFaceH4 mistral 7b grok
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-v0.1-sharded
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · nagarhimanshu37
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
MI
Bitnet Mistral.0.2 47m
Mistral · RichardErkhov
Params48M
Context8K
Q4_K_M0.0 GB
GGUF
MI
mistral stargate
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
klcsp mistral 7b 0.3 gpt4o 100k coding fft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · gravermistakes
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
synapsellm 7b mistral v0.4 preview2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
supermario slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
AQUA-7B
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
shleeeee mistral ko OpenOrca wiki v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct RR i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeverSleep Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Small 2501 Tensopolis v1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
s1ghhh which8 mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
K2S3 Mistral 7b v1.2
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mixtral AI MediTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ko Mixtral v1.3
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral_7B Open_Hermes NSFWV1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
KafkaLM Mixtral 8x7B V0.2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
ShoriRP v0.75d
Mistral · lemonilia
Params7.24B
Context32K
Smallest5.9 GB
GGUF
MI
Mistral-7B-v0.1-sft-harmful-hhrlhf-gen-dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin-2.9-mixtral-8x22b
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
CodingTool use
MI
Mistral 7B Base SFT SLiC HF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AlexeyRyzhikov mistral7b text to xml v1.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Orpo Capybara 7k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing