Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi4 ModelStock 14B
Phi · mradermacher
Params14B
Context16K
Q4_K_M8.6 GB
GGUF
PH
Phi 4 Mini 4k Instruct Novel Naut
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · ginesew43
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi IMDB Merged
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · AlessandroW
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Reasoning
Phi · viniciusianni
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoningTool use
PH
Einstein v6.1 phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Microsoft Phi3 14B Instruct128K
Phi · CHE-72-ZLab
Params14B
Context128K
Smallest5.1 GB
Coding
PH
PARM Phi 3.5 mini o1
Phi · Pinkstack
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
matteogeniaccio.phi 4
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
weifar FTAudit phi 3 5 mini v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 reasoning DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
Reasoning
PH
Phi 3 Mini 128k Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
Phi 3 mini 4k instruct GGUF v2
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
ostapbodnar Phi3.5 mini ua mixed
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Open R1 Distill EZOv1
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
phi4 o1
Phi · SunJack
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Medium 4k Instruct Abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · REX-AI-ANALYSE
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 RR Shoup i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
Wukong Phi 3 Instruct Ablated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
WasamiKirua Samantha2.0 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Sayan01/Phi3-TL-ORCA-1
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
ihughes15234 phi 3 5 mini tictactoe1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · jc-builds
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Cream Phi 3 14B v1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing