Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammen10 mistral 7B GGUF IQ Imatrix Testing
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CorticalStack mistral 7b openhermes sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
dolphin 2.6 mistral 7B dpo laser GGUF imatrix
Mistral · lr1729
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
japanese mistral 300m instruction
Mistral · afrideva
Params355M
Context4K
Q4_K_M0.2 GB
GGUF
MI
Mistral 7B v0.1 GGUF fp16
Mistral · ddh0
Params7.24B
Context32K
Smallest14.5 GB
GGUF
MI
LlaSMol Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenZephyrChat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler constant dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistralai.Mistral Medium 3.5 128B
Mistral · DevQuasar
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
MI
Mistral-7B-Discord-0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DOMICILE IN mistral 7B smallset
Mistral · transitionGap
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
Zephyr 7b Beta
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Abliterated HF
Mistral · NINI26454
Params23.6B
Context32K
Smallest11.5 GB
Tool use
MI
osanseviero mistral instruct slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Astronomy 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral 22B v0.1
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
wang7776/Mistral-7B-Instruct-v0.2-sparsity-10
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Bio Mistralv2 Squared i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Yarn Mistral 7b 128k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Candle dolphin 2.2.1 mistral 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
laser-dolphin-mixtral-2x7b-dpo
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral quiet star GGUF f16
Mistral · liminerity
Params7.24B
Context32K
Smallest14.5 GB
GGUF
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
models--mergekit-community--JackRussell
Mistral · MaziyarPanahi
Params8.99B
Context32K
Q4_K_M5.4 GB
Tool use

Keep browsing