Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
fpham_autolycus-mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
MI
leolm_leo-mistral-hessianai-7b-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b orpo capybara reproduction
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Devstral Small 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
RenCoder Ministral 8B Instruct 2410
Mistral · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 8B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Chinese Mixtral 8x7B
Mistral · RichardErkhov
Params46.9B
Context32K
Q4_K_M28.6 GB
MI
Devstral Small 2507 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M14.5 GB
MI
Hermes-2-Pro-Mistral-7B-infinity
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 ultra uncensored heretic
Mistral · llmfan46
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
maywell_pivot-10.7b-mistral-v0.2-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
lemonilia_ashhlimarp-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB
MI
monology_openinstruct-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI CyberTron Ultra
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
MI
OpenHermes 2.5 Mistral 7B Orca DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
danielbrdz_barcenas-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rana shahroz mistral 7b openorca20k
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB