Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
internlm2-math-plus-mixtral8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
MI
Ministral 3 8B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
mistral7b_ocr_to_json_v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistrality-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Wayfarer Eris Noctis Mistralified 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-7B-Instruct-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ja ck Mistral instruct Y24 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ae Calem Mistral 7b v0.2
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
MI
avemio digital mistral continued training pre trained
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev mistral alpaca sft sample 3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3 24B
Mistral · EasierAI
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
DistilHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 8bit Abliterated Layer18
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Large 4 1T A52B
Mistral · orcarouter
Params1050B
Context1024K
Smallest1.4 GB
MI
testllm c2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 Heretic v1.2 2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
NeuralHyperion 2.0 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz256 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-Small-4-119B-2603
Mistral · stefan-terdell-cleura
Params119B
Context1024K
Q4_K_M73.7 GB
MI
Mistral-11B-OmniMix
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Mixtral-8x22B-Instruct-v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.7 GB
MI
Openbuddy Mistral7B v19.1 4k
Mistral · RichardErkhov
Params7.28B
Context32K
Q4_K_M4.4 GB
MI
Amod mental health therapy mistral 7b ins SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 imatrix
Mistral · hermes42
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct RDPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · CISCai
Params7.25B
Context32K
Smallest1.6 GB
MI
Mistral Nemo MCAI SFT
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct guidance Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB