Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
OpenPipe mistral ft optimized 1218
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Base 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Small 2 24B Instruct 2512
Mistral · professorf
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool use
MI
mlfoundations dev mistral alpaca sft sample 8
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sanchit gandhi distil mistral 1.5B v0.1
Mistral · RichardErkhov
Params1.57B
Context32K
Q4_K_M1.0 GB
GGUF
MI
Mixtral 13Bx2 MOE 22B
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
MI
MistralSmall22bAlpacaContinued
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
synapsellm-7b-mistral-v0.4-preview2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammen13 mistral 7B GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Franken Mistral Merlinite Maid i1
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI CyberUltron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoningRoleplay
MI
juhwanlee llmdo Mistral 7B case 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch3 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
20240105_mistral Step50
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral Uphill Crush Crest v0.4
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Agnuxo Mamba Codestral 7B Instruct CODE Python Spanish English Asistant 16bit v2
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
MI
Codestral 22B v0.1 OBLITERATED
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Mistral Nemo Base 2407 RP Merge V2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningRoleplay
MI
Mistral Small 24B Instruct Jbliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Large 218B Instruct
Mistral · mradermacher
Params218B
Context128K
Smallest46.0 GB
GGUF
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
disi unibo nlp mistral SFT medqa triples nographeval cot
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral dolphin mix cine open Ne
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing