Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
shleeeee mistral ko OpenOrca 2000
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Heidrun Mistral 7B base i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · gaianet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
TalentInc talent rio summary mistral 7b lora 5400 v1 rev 1 merged
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral dMoE multi 18
Mistral · mradermacher
Params8.96B
Context32K
Q4_K_M5.6 GB
GGUF
MI
NeuralHyperion 2.0 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
em german leo mistral Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rcoqutv
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral nemo
Mistral · cortexso
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mixtral 8x22b instruct v0.1 topo cbp
Mistral · frankmorales2020
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
juhwanlee llmdo Mistral 7B case c v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CorticalStack mistral 7b jondurbin truthy dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin-2.6-mistral-7b-dpo-orca-v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
Mistral Grand R1 Dolphin 3.0 Deep Reasoning Brainstorm 45B
Mistral · DavidAU
Params45.2B
Context32K
Smallest16.8 GB
ReasoningRoleplay
MI
Mixtral8_7B_Psychology_Myers
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 40 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
.\Mermaid\
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mp_Mistral7Bv3_Sft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
CodeCalc Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz256
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral DPO Uncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz2048
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.9995 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-it-v1.7.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
lamm mit mistral 7B v0.3 Base CPT SFT DPO 09022024
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing