Biomistral GGUF models

103 GGUF models in the Biomistral family, quantized by 32 uploaders. Sizes run from 7.24B to 24.2B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BI
BioMistral 7B SLERP
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral-7B
Biomistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Biomistral_E57B_Merge_Tydien
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Biomistral Exp Slerp
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral Clinical 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
BI
BioMistral Zephyr Beta SLERP i1
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · 141-Dani
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · nold
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B finetuned
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B SLERP
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral v0.2
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B TIES
Biomistral · Kquant03
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B TIES
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral RAG
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral merged zephyr
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B DARE
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Kabster/BioMistral-MedicalQA-FT
Biomistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B TIES
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral BioMistral 7B
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
BioMistral Instructv0.2 7B DARE
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Aerova Nova 2.5B
Biomistral · AeroxLabs
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
BioMistral Zephyr Beta SLERP
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
BioMistral BioMistral DARE NS
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral-Ko-2x7B
Biomistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
BI
BioMistral 7B Natural Products RE Diversity 1000 synt v1.2
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
BI
BioMistral 6E7B
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral ALL
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing