Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
flammen10 mistral 7B GGUF IQ Imatrix Testing
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack mistral 7b openhermes sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.6 mistral 7B dpo laser GGUF imatrix
Mistral · lr1729
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
japanese mistral 300m instruction
Mistral · afrideva
Params355M
Context4K
Q4_K_M0.2 GB
MI
Mistral 7B v0.1 GGUF fp16
Mistral · ddh0
Params7.24B
Context32K
Smallest14.5 GB
MI
LlaSMol Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenZephyrChat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler constant dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai.Mistral Medium 3.5 128B
Mistral · DevQuasar
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral-7B-Discord-0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b sft full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DOMICILE IN mistral 7B smallset
Mistral · transitionGap
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Zephyr 7b Beta
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 Abliterated HF
Mistral · NINI26454
Params23.6B
Context32K
Smallest11.5 GB
MI
osanseviero mistral instruct slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Astronomy 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Codestral 22B v0.1
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
wang7776/Mistral-7B-Instruct-v0.2-sparsity-10
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Bio Mistralv2 Squared i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Yarn Mistral 7b 128k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Candle dolphin 2.2.1 mistral 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
laser-dolphin-mixtral-2x7b-dpo
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral quiet star GGUF f16
Mistral · liminerity
Params7.24B
Context32K
Smallest14.5 GB
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
models--mergekit-community--JackRussell
Mistral · MaziyarPanahi
Params8.99B
Context32K
Q4_K_M5.4 GB