Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi4 ModelStock 14B
Phi · mradermacher
Params14B
Context16K
Q4_K_M8.6 GB
PH
Phi 4 Mini 4k Instruct Novel Naut
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Mini Instruct
Phi · ginesew43
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi IMDB Merged
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 mini 128k instruct
Phi · AlessandroW
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning
Phi · viniciusianni
Params3.84B
Context128K
Smallest4.1 GB
PH
Einstein v6.1 phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Microsoft Phi3 14B Instruct128K
Phi · CHE-72-ZLab
Params14B
Context128K
Smallest5.1 GB
PH
PARM Phi 3.5 mini o1
Phi · Pinkstack
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
matteogeniaccio.phi 4
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
weifar FTAudit phi 3 5 mini v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 reasoning DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
PH
Phi 3 Mini 128k Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest3.1 GB
PH
Phi 3 mini 4k instruct GGUF v2
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
ostapbodnar Phi3.5 mini ua mixed
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Open R1 Distill EZOv1
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi4 o1
Phi · SunJack
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Medium 4k Instruct Abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · REX-AI-ANALYSE
Params3.84B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini TitanFusion 0.4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 RR Shoup i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Wukong Phi 3 Instruct Ablated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
WasamiKirua Samantha2.0 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Sayan01/Phi3-TL-ORCA-1
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
ihughes15234 phi 3 5 mini tictactoe1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Mini Instruct
Phi · jc-builds
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Cream Phi 3 14B v1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB