Biomistral GGUF models

103 GGUF models in the Biomistral family, quantized by 32 uploaders. Sizes run from 7.24B to 24.2B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BI
BioMistral 7B
Biomistral · Gustav098
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B DARE Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
biomistral finetuned medchat Q4 K M
Biomistral · Gustav098
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · jmainformatique
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Biomistral_Finetuned_Medchat2
Biomistral · Gustav098
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
MixtureofMerges-MoE-4x7bRP-v11
Biomistral · jsfs11
Params24.2B
Context32K
Q4_K_M14.6 GB
RoleplayVision
BI
BioMistral DARE NS
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
biomistral health
Biomistral · asadullahshehbaz
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
biomistral context behavior
Biomistral · asadullahshehbaz
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral BioMistral MedMNX
Biomistral · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
BI
Biomistral Cdss Merged
Biomistral · krishnaveni0226
Params7.24B
Context32K
Smallest7.7 GB
GGUF
BI
BioMistral 7B
Biomistral · nagasaich123
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Biomistral meddialog response Q4 K M
Biomistral · Gustav098
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing