Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mixtral AI CyberTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Free_Sydney_V2_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo 12B
Mistral · EasierAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Hermes 2 Pro 11B
Mistral · MaziyarPanahi
Params11.2B
Context32K
Q4_K_M6.7 GB
MI
Mistral Large 4 1T A52B Uncensored
Mistral · AtomicChat
Params114M
Context—
Smallest0.5 GB
MI
mistral 7b v0.2 q4 0
Mistral · djmango
Params7.24B
Context32K
Smallest4.1 GB
MI
French-Alpaca-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mahou-1.3b-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral Instruct 2410 8B DPO RP i1
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Ministral 3 14B Instruct 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
lightblue Karasu Mixtral 8x22B v0.1
Mistral · mmnga
Params141B
Context64K
Smallest29.6 GB
MI
dolphin 2.6 mistral 7b dpo laser
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b orpo v3.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mamba Codestral 7B v0.1 instruct python coding assistant GGUF 4bit
Mistral · Agnuxo
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
CapybaraHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Helcyon Grok
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mistral orpo beta
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Magistral Small 2506
Mistral · lmstudio-community
Params23.6B
Context48K
Q4_K_M14.3 GB
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI CyberBrain SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral Nemo 12B RP
Mistral · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
abacusai_bigstral-12b-32k
Mistral · dagbs
Params12.5B
Context32K
Q4_K_M7.5 GB
MI
laser dolphin mixtral 2x7b dpo
Mistral · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Eclipse-mistral-4x7b
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Mistral Nemo Batman Venom
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB