Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 3 on mac Q3 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · PabloSuaLap
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Aurumdev95
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 2
Phi · weimenglin
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 14b
Phi · StageMind
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · aayushg159
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 4 Q4 K M
Phi · roleplaiapp
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi4 azure
Phi · Mazino0
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · andysalerno
Params14B
Context128K
Smallest14.8 GB
Coding
PH
Einstein v4 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
CodingTool use
PH
AINewsSummarizer 20250824 113319
Phi · devparagiri
Params2.77B
Context2K
Smallest3.0 GB
GGUF
PH
phi 2 sql
Phi · nakcnx
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
phi 4 Q5 K M
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.6 GB
CodingRoleplay
PH
phi3.5 resume fp16
Phi · Hathija
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
ggml phi 4 reasoning vision 15b q8 0
Phi · Manojb
Params14.7B
Context32K
Smallest16.1 GB
ReasoningVision
PH
Phi 4 Reasoning
Phi · ghostoverflow
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 3 medium 128k instruct Q6 K
Phi · CHE-72
Params14B
Context128K
Smallest11.5 GB
Coding
PH
Phi 3.5 Mini instruct_Uncensored
Phi · flyfishstudio
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi 4 14b
Phi · ruanwz
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi4 Reasoning Ties 0.5
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi medmcqa question generation physiology lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Smallest2.2 GB
CodingTool use
PH
phi 2 instruct v1
Phi · timothyckl
Params2.78B
Context2K
Smallest1.7 GB
Coding
PH
phi 3 on mac Q6 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest3.1 GB
GGUF
PH
phi 3 medium 4k instruct
Phi · neopolita
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi3.1 Simple Arguments
Phi · cris177
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · viniciusianni
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
phi 3 portuguese tom cat 4k instruct Q4 K M GGUF PTBR
Phi · noxinc
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
xenith 3b
Phi · XeroCodes
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
bhanudaybirla phi3 dapt1
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing