Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral AI CyberTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Free_Sydney_V2_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo 12B
Mistral · EasierAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Hermes 2 Pro 11B
Mistral · MaziyarPanahi
Params11.2B
Context32K
Q4_K_M6.7 GB
Tool use
MI
Mistral Large 4 1T A52B Uncensored
Mistral · AtomicChat
Params114M
Context—
Smallest0.5 GB
GGUF
MI
mistral 7b v0.2 q4 0
Mistral · djmango
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MI
French-Alpaca-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mahou-1.3b-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral Instruct 2410 8B DPO RP i1
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
MI
Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Ministral 3 14B Instruct 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
lightblue Karasu Mixtral 8x22B v0.1
Mistral · mmnga
Params141B
Context64K
Smallest29.6 GB
GGUF
MI
dolphin 2.6 mistral 7b dpo laser
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
mistral 7b orpo v3.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mamba Codestral 7B v0.1 instruct python coding assistant GGUF 4bit
Mistral · Agnuxo
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
MI
CapybaraHermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Helcyon Grok
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
mistral orpo beta
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Magistral Small 2506
Mistral · lmstudio-community
Params23.6B
Context48K
Q4_K_M14.3 GB
Reasoning
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · l3utterfly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI CyberBrain SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral Nemo 12B RP
Mistral · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
abacusai_bigstral-12b-32k
Mistral · dagbs
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
MI
laser dolphin mixtral 2x7b dpo
Mistral · macadeliccc
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Eclipse-mistral-4x7b
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Tool use
MI
Mistral Nemo Batman Venom
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF

Keep browsing