Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
internlm2-math-plus-mixtral8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool use
MI
mistral7b_ocr_to_json_v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistrality-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Wayfarer Eris Noctis Mistralified 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral-7B-Instruct-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ja ck Mistral instruct Y24 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ae Calem Mistral 7b v0.2
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
MI
avemio digital mistral continued training pre trained
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev mistral alpaca sft sample 3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3 24B
Mistral · EasierAI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
DistilHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.2 8bit Abliterated Layer18
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Large 4 1T A52B
Mistral · orcarouter
Params1050B
Context1024K
Smallest1.4 GB
GGUF
MI
testllm c2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Heretic v1.2 2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
MI
NeuralHyperion 2.0 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mlfoundations dev hp ablations mistral bsz256 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-Small-4-119B-2603
Mistral · stefan-terdell-cleura
Params119B
Context1024K
Q4_K_M73.7 GB
Tool useVision
MI
Mistral-11B-OmniMix
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mixtral-8x22B-Instruct-v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.7 GB
GGUF
MI
Openbuddy Mistral7B v19.1 4k
Mistral · RichardErkhov
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Amod mental health therapy mistral 7b ins SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3 imatrix
Mistral · hermes42
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral 7B Instruct RDPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · CISCai
Params7.25B
Context32K
Smallest1.6 GB
Tool use
MI
Mistral Nemo MCAI SFT
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B Instruct guidance Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing