Medical GGUF models

264 GGUF models in the Medical family, quantized by 139 uploaders. Sizes run from 23M to 32.8B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
medical qa vistral i1
Medical · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
ME
medical tracker chatbot i1
Medical · mradermacher
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Medical QnA gpt2
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Intelligent Internet.II Medical 7B Preview
Medical · DevQuasar
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
ME
medical_llm_spidercore_8B
Medical · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
ME
Intelligent Internet.II Medical 8B
Medical · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
ME
medical model
Medical · Jacally
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
ME
medical treatment
Medical · daleilei
Params8.03B
Context128K
Smallest8.5 GB
GGUF
ME
medical chatbot
Medical · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ME
medical fine tunee
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical 1000 64 16 jinaai jina embeddings v2 small en 1000 gpt 3.5 tur 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical document understanding gguf v2
Medical · Sebukpor
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
ME
medical term similarity
Medical · mradermacher
Params23M
Context512
Q4_K_M0.0 GB
Embedding
ME
Intelligent Internet II Medical 8B
Medical · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
GGUF
ME
medical phi FineTuned i1
Medical · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
ME
Medical QnA Gpt2
Medical · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
II Medical 8B 1706
Medical · ReallyFloppyPenguin
Params8.19B
Context40K
Smallest4.8 GB
GGUF
ME
Medical_Transcription_Generator
Medical · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical q and a
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Medical QandA
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical 1000 64 16 jinaai jina embeddings v2 small en 10 gpt 4 turbo 0 9062874564 i1
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
medical gpt2 i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Medical QnA gpt2 i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical question and answer gpt2 i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
Medical QA
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical tracker chatbot
Medical · mradermacher
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical 10 10 1 jinaai jina embeddings v2 small en 50 gpt 3.5 turbo 01 9062874564
Medical · mradermacher
Params32M
Context8K
Q4_K_M0.0 GB
Embedding
ME
Medical Question Answer
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
medical qa model i1
Medical · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
ME
II Medical 8B f32
Medical · prithivMLmods
Params8.19B
Context40K
Smallest16.4 GB
GGUF

Keep browsing