Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 3.5 med pulm peds
Phi · SiaZay
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Einstein v4 phi2 Q8 0
Phi · hus960
Params2.78B
Context2K
Smallest3.0 GB
CodingTool use
PH
phi3-unsloth
Phi · vishalvaibhavn
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · dohque
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
model
Phi · T20091125276
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · maxkulish
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 4 Q2 K
Phi · RCorvalan
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · raghav0
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 4 Q4 K M
Phi · HP77777
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 2
Phi · modelfix
Params2.78B
Context2K
Smallest1.7 GB
GGUF
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest5.8 GB
GGUF
PH
tf phi3.5 q4
Phi · TheHost
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · straino
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi mts dialogue clinical note CC
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct Heretic
Phi · TitleOS
Params3.84B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 Tensopolis v1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k instruct Friendly
Phi · cowWhySo
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 3.5 sakura yuzu v3.0 Q8 0
Phi · win10
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · JulianChang
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi3 Finetuned Model
Phi · quasar-011
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi2 openhermes20k Q2 K
Phi · haripritam
Params2.78B
Context2K
Smallest1.1 GB
Tool use
PH
phi4 claude reasoning
Phi · ykarout
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 3.5 Mini ChatML Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · RCorvalan
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
Phi 3.5 Mini Instruct LoRA 32
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
convex 20250806 234809
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
yt seo phi4 merged
Phi · SujalChhajed925
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi-gguf
Phi · ALI-B
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 3.5 25k
Phi · showvikdbz
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
medical phi3
Phi · RamRamki
Params3.82B
Context4K
Smallest3.1 GB
GGUF

Keep browsing