Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Smut_Mistral_7B02_V0_Merged
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NousResearch Nous Hermes 2 Mistral 7B DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
HuggingFaceH4 mistral 7b grok
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-v0.1-sharded
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · nagarhimanshu37
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Bitnet Mistral.0.2 47m
Mistral · RichardErkhov
Params48M
Context8K
Q4_K_M0.0 GB
MI
mistral stargate
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
klcsp mistral 7b 0.3 gpt4o 100k coding fft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · gravermistakes
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
synapsellm 7b mistral v0.4 preview2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
supermario slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AQUA-7B
Mistral · Mungert
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
shleeeee mistral ko OpenOrca wiki v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct RR i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeverSleep Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Small 2501 Tensopolis v1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
s1ghhh which8 mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7b v1.2
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
Mixtral AI MediTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ko Mixtral v1.3
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
OpenHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral_7B Open_Hermes NSFWV1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KafkaLM Mixtral 8x7B V0.2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
ShoriRP v0.75d
Mistral · lemonilia
Params7.24B
Context32K
Smallest5.9 GB
MI
Mistral-7B-v0.1-sft-harmful-hhrlhf-gen-dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin-2.9-mixtral-8x22b
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
MI
Mistral 7B Base SFT SLiC HF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AlexeyRyzhikov mistral7b text to xml v1.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Orpo Capybara 7k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB