Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Base 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · professorf
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
mlfoundations dev mistral alpaca sft sample 8
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sanchit gandhi distil mistral 1.5B v0.1
Mistral · RichardErkhov
Params1.57B
Context32K
Q4_K_M1.0 GB
MI
Mixtral 13Bx2 MOE 22B
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
MI
MistralSmall22bAlpacaContinued
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
synapsellm-7b-mistral-v0.4-preview2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
flammen13 mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Franken Mistral Merlinite Maid i1
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Mixtral AI CyberUltron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
juhwanlee llmdo Mistral 7B case 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral epoch3 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
20240105_mistral Step50
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral Uphill Crush Crest v0.4
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Agnuxo Mamba Codestral 7B Instruct CODE Python Spanish English Asistant 16bit v2
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Codestral 22B v0.1 OBLITERATED
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral Nemo Base 2407 RP Merge V2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Mistral Small 24B Instruct Jbliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Large 218B Instruct
Mistral · mradermacher
Params218B
Context128K
Smallest46.0 GB
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
disi unibo nlp mistral SFT medqa triples nographeval cot
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral dolphin mix cine open Ne
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB