Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
MI
QI mistral 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Sisyphus 24b 2503 i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
malaysian mistral 7b 32k instructions
Mistral · prsyahmi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Team Leader Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo gutenberg 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · second-state
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo wissenschaft 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 3B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Vitus Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-Small-4-119B-2603
Mistral · AtomicChat
Params119B
Context1024K
Smallest49.6 GB
MI
Mistral 7B v0.3 3MPER0RR Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
LiberatedHermes 2 Pro Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SlimHercules 4.0 Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mistral Nemo MCAI SFT i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Voxtral Mini 4B Realtime Arabic
Mistral · mradermacher
Params3.43B
Context128K
Q4_K_M2.2 GB
MI
Hyperion 1.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
MI
bellman 7b mistral instruct v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Darkens 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · ggml-org
Params13.5B
Context256K
Smallest14.4 GB
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB