Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 2 OpenHermes 2.5 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · liodon-ai
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi2 bunny
Phi · justinj92
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi4.React.Turn.V2.Full
Phi · Quazim0t0
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
martinLLM phi 4b 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2
Phi · zillioncart3930
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
Phi 4 RStock v0.1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 4
Phi · tensorblock
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
mts phi3.5 mini 4K
Phi · hungmol
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi3 3.5 OH SFT 3
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi3.5 Comets 3.8B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
objectivist phi4 CP SFT merge
Phi · peikoff
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
ihughes15234 phi 3 mini 500 combined 5 2 epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
cream phi 2 v0.2
Phi · BeaverLegacy
Params2.78B
Context2K
Smallest3.0 GB
Coding
PH
miguelcarv phi 1 5 slimorca
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 4 Deepseek R1 Distilled v8
Phi · ykarout
Params14.7B
Context16K
Q4_K_M9.7 GB
CodingReasoning
PH
bgGPT Phi 4
Phi · burgasdotpro
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi Elothir
Phi · mradermacher
Params5.14B
Context2K
Q4_K_M3.2 GB
GGUF
PH
Phi3 3.5 OH SFT 0
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Nova FinLex Phi3
Phi · Kami574
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · DhruvalLabs
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3.5 Mini instruct_Uncensored
Phi · ZeroWw
Params3.82B
Context128K
Smallest2.5 GB
GGUF
PH
Phi 3.5 24 10 06
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
akshit Gupta phi3alpaca fullnew merged FinetunedByAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
RyotaKadoya1993 phi3 wiki merged
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
phi3 hallucination judge merge
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
PHI 4 ReasonP
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3.5 Mini Instruct
Phi · hellork
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
cheme phi3
Phi · bruhpika
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing