Medical GGUF models

264 GGUF models in the Medical family, quantized by 139 uploaders. Sizes run from 23M to 32.8B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
medical translator es en
Medical · dammi19
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
Medical_Dialogue
Medical · yc1154645
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
Medical_Dialogue2
Medical · yc1154645
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
Medical_Miracle
Medical · yangshuai123
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
Medical Model
Medical · lyj1998
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical model
Medical · msn66
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical model
Medical · kunkunking
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
Medical_Test_Data
Medical · SmitTrivedi
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
Medical_Finetuned
Medical · antweiyi
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
Medical Model
Medical · andyymcheung
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
Medical Model 8B 0921
Medical · ai4lifeinstitute
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ME
medical model
Medical · peterfei
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical phi FineTuned
Medical · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
ME
medical helper Q8 0
Medical · MLking2
Params1.24B
Context128K
Smallest1.3 GB
Tool use
ME
medical_v3_gguf
Medical · mohammad2928git
Params8.03B
Context8K
Smallest16.1 GB
GGUF
ME
medical finetune
Medical · yangjinghit5
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical model
Medical · lanyu000001
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical helper Q4 K M
Medical · MLking2
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ME
medical llm 14B
Medical · Jiseungmin
Params14.8B
Context128K
Smallest15.7 GB
ReasoningTool use
ME
medical model
Medical · boagolden
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
Medical 1.5B
Medical · yangjianhua
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
ME
medical extractor v15
Medical · piyushf
Params494M
Context32K
Smallest0.4 GB
Tool use
ME
medical finetuned
Medical · William910
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical extractor v13
Medical · piyushf
Params494M
Context32K
Smallest0.4 GB
Tool use
ME
medical summarizer
Medical · hanzohazashi1
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ME
medical model demo
Medical · aliangHF
Params1.78B
Context128K
Smallest1.9 GB
ReasoningTool use
ME
Medical
Medical · a54878745870518
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
medical qa generation gpt2
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical_v2_gguf
Medical · mohammad2928git
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ME
Medical
Medical · duncan12
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use

Keep browsing