Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral NeMo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
akjindal53244_arithmo-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
teknium_airoboros-mistral2.2-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Pygmalion 7B
Mistral · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
OpenHermes-2.5-Mistral-7B-x2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
severian_anima-phi-neptune-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tamil-Mistral-7B-v0.1
Mistral · RichardErkhov
Params7.39B
Context32K
Q4_K_M4.5 GB
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
MI
Mistral Small 4 119B 2603 GGUF HALO
Mistral · Beinsezii
Params119B
Context—
Smallest0.1 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
models--automerger--Experiment28T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
emrgnt-cmplxty_mistral-7b-phibrarian-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B Instruct DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
MI
Magistral-Small-2506
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Mistral 7B Cymraeg Welsh v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
YuisekinAIEvol Mistral 7B ja math v0.1.1
Mistral · mmnga
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ELISARCyberAIEdge7B LoRA
Mistral · sallani
Params42M
Context—
Smallest0.2 GB
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · crusoeai
Params141B
Context64K
Q4_K_M85.6 GB
MI
nousresearch_yarn-mistral-7b-128k
Mistral · TheBloke
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB