Medical GGUF models

264 GGUF models in the Medical family, quantized by 139 uploaders. Sizes run from 23M to 32.8B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
st medical 3b
Medical · StamCHik
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
Medical Question Answer
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical expert
Medical · parththedevil
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
ME
medical 20 0 16 jinaai jina embeddings v2 small en 1000 gpt 4 turbo 01 9062874564
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
4o 3b medical
Medical · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ME
medical model
Medical · forestav
Params1.24B
Context128K
Smallest2.5 GB
Tool use
ME
medical 20 0 16 jinaai jina embeddings v2 small en 100 gpt 3.5 turbo 0 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical suite v1
Medical · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
ME
medical model
Medical · magic2025
Params8.03B
Context128K
Smallest8.5 GB
Tool use
ME
medical model
Medical · shijiale1995
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical model q4
Medical · forestav
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ME
medical chatbot
Medical · Fnasrin
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ME
medical 10 10 1 jinaai jina embeddings v2 small en 50 gpt 3.5 turbo 01 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
II Medical 7B Preview
Medical · fgewfskjfsd
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
ME
medical qa gpt2
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Medical Summary
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical 100 64 16 jinaai jina embeddings v2 small en 100 gpt 3.5 turbo 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical 20 0 16 jinaai jina embeddings v2 small en 1000 gpt 4 turbo 01 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical model
Medical · jeff-fung
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
Medical Model
Medical · Ahmad-AbuSaleh
Params8.03B
Context128K
Smallest16.1 GB
GGUF
ME
medical finetuning
Medical · ddomsnf21
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ME
medical bot
Medical · BoscoTheDog
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ME
medical entities json
Medical · erixhensBTE
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
ME
medical 20 0 16 jinaai jina embeddings v2 small en 100 gpt 3.5 turbo 0 9062874564
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
Intelligent Internet II Medical 8B 1706
Medical · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
GGUF
ME
medical fine tunee i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical 1000 64 16 jinaai jina embeddings v2 small en 10 gpt 4 turbo 0 9062874564
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical_v1_gguf
Medical · mohammad2928git
Params8.03B
Context8K
Smallest5.7 GB
GGUF
ME
medical-model
Medical · marshal007
Params7.62B
Context32K
Smallest8.1 GB
Tool use
ME
medical diagnostic IA i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing