Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
shleeeee mistral ko OpenOrca 2000
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Heidrun Mistral 7B base i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · gaianet
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
TalentInc talent rio summary mistral 7b lora 5400 v1 rev 1 merged
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral dMoE multi 18
Mistral · mradermacher
Params8.96B
Context32K
Q4_K_M5.6 GB
MI
NeuralHyperion 2.0 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
em german leo mistral Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-rcoqutv
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo
Mistral · cortexso
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mixtral 8x22b instruct v0.1 topo cbp
Mistral · frankmorales2020
Params141B
Context64K
Q4_K_M85.6 GB
MI
juhwanlee llmdo Mistral 7B case c v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack mistral 7b jondurbin truthy dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin-2.6-mistral-7b-dpo-orca-v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Grand R1 Dolphin 3.0 Deep Reasoning Brainstorm 45B
Mistral · DavidAU
Params45.2B
Context32K
Smallest16.8 GB
MI
Mixtral8_7B_Psychology_Myers
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 40 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
.\Mermaid\
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mp_Mistral7Bv3_Sft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
CodeCalc Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz256
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral DPO Uncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz2048
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral adambeta2 0.9995 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-7b-it-v1.7.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
lamm mit mistral 7B v0.3 Base CPT SFT DPO 09022024
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB