Biomistral GGUF models

103 GGUF models in the Biomistral family, quantized by 32 uploaders. Sizes run from 7.24B to 24.2B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
BI
BioMistral v0.2 i1
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral Zephyr Beta SLERP
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral-Ko-9B
Biomistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
BI
BioMistral 7B TIES
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
BioMistral MedMNX
Biomistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
BI
BioMistral LLM
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B Nachos
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral Nachos 7B Instruct
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B OpenHermes SLERP
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
BI
BioMistral 7B
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistralMerged
Biomistral · skfrost19
Params7.24B
Context32K
Smallest7.7 GB
GGUF
BI
BioMistral MedMNX
Biomistral · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
BI
Biomistral 7b Fp16
Biomistral · anthonytaylor3233
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral Instruct MIMIC 7B DARE
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
biomistral v1
Biomistral · arjunssat
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B Q5 K M
Biomistral · Szahriwar
Params7.24B
Context32K
Smallest5.1 GB
GGUF
BI
BioMistral 7B TIES Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Biomistral meddialog diagnose Q4 K M
Biomistral · Gustav098
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B SLERP Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B
Biomistral · VISHNUDHAT
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
biomistral
Biomistral · patrickbdevaney
Params7.24B
Context32K
Smallest3.1 GB
GGUF
BI
BioMistral 7B
Biomistral · gguf
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B Elife Lora Only Q5 K M
Biomistral · Szahriwar
Params7.24B
Context32K
Smallest5.1 GB
GGUF
BI
BioMistral merged zephyr Q4 K M
Biomistral · Johnyquest7
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral_Lora_Fine Tuned_test
Biomistral · PradeepBodhi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
mergeMathBio 7B
Biomistral · miraiminds
Params7.24B
Context32K
Smallest7.7 GB
GGUF
BI
biomistral chat
Biomistral · praneshv29
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BioMistral 7B Gguf 8bit
Biomistral · Szahriwar
Params7.24B
Context32K
Smallest7.7 GB
GGUF
BI
BioMistral-Ko-10.7B
Biomistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF

Keep browsing