Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
ihughes15234 phi35 kp dpo3epoch nonadvtrain
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Unsloth Bnb 4bit
Phi · nguyenmanhd93
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 thinking
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Medium 4k Instruct
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
Coding
PH
Phi 3 Medium 4k Instruct
Phi · xaskasdf
Params14B
Context4K
Smallest5.3 GB
GGUF
PH
Phi 3.5 Health Chatbot
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · cahaj
Params3.82B
Context128K
Smallest2.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · SandLogicTechnologies
Params14.7B
Context32K
Smallest6.9 GB
Reasoning
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2 layla v1
Phi · l3utterfly
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
Ektome Phi 3 mini 4k instruct PristinelyUncensored
Phi · Zynerji
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi3 mini WeatherBot
Phi · VatsalPatel18
Params3.82B
Context4K
Smallest2.4 GB
Coding
PH
Phi 4 Reasoning Vision 15B ROCmFPX Q8 0
Phi · kingjones777
Params14.7B
Context32K
Smallest15.2 GB
ReasoningVision
PH
Mykes med phi3 mini 4k merged
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
History Phi4 Lora Sft v2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 medium 4k instruct abliterated v3
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · hellork
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
omost phi 3 mini 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 clinical
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Math IO
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · hellork
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
yujiepan phi 3 tiny random
Phi · RichardErkhov
Params—
Context128K
Q4_K_M0.0 GB
GGUF
PH
microsoft phi 1
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
phi 4
Phi · smarttasks
Params14.7B
Context16K
Q4_K_M9.1 GB
Tool use
PH
Phi medmcqa question generation pathology lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 Slerp4 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Moxoff Phi3Mini KTO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3 medical del ltr
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 5 mini kp 12k cfr sft
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing