Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
MI
QI mistral 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Sisyphus 24b 2503 i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
MI
Hermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
malaysian mistral 7b 32k instructions
Mistral · prsyahmi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Team Leader Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo gutenberg 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · second-state
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo wissenschaft 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ministral 3 3B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Vitus Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral-Small-4-119B-2603
Mistral · AtomicChat
Params119B
Context1024K
Smallest49.6 GB
ReasoningTool useVision
MI
Mistral 7B v0.3 3MPER0RR Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
EmbeddingTool use
MI
LiberatedHermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
SlimHercules 4.0 Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mistral Nemo MCAI SFT i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Voxtral Mini 4B Realtime Arabic
Mistral · mradermacher
Params3.43B
Context128K
Q4_K_M2.2 GB
Vision
MI
Hyperion 1.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
Coding
MI
bellman 7b mistral instruct v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · ggml-org
Params13.5B
Context256K
Smallest14.4 GB
ReasoningTool useVision
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing