Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3.5 Mini Instruct
Phi · worthdoing
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct Abliterated
Phi · PJRM
Params3.84B
Context128K
Smallest2.3 GB
PH
DeepThinkers Phi4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
ScholasticLogicAI Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Llava Phi 3 Mini Xtuner
Phi · faceradix
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
lucapopescu phi3 unit tester
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 4 mini obliterated
Phi · ArRENCEAI
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
joke finetome model gguf phi4 20260111 113458
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
Stoicism1 Phi3.5 mini instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k instruct gguf
Phi · femijoshuaalabi
Params3.82B
Context4K
Smallest2.4 GB
PH
Phi 4 Mini Instruct
Phi · WorkOffline
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 mini 128k instruct Q6 K
Phi · CHE-72
Params3.82B
Context128K
Smallest3.1 GB
PH
ihughes15234 phi35 kp dpo1epoch 1e6lr
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Haesteining.Phi3smallv5
Phi · DevQuasar-3
Params5.63B
Context128K
Q4_K_M3.5 GB
PH
Phi 4 Mirage Sol Reasoning 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 mini 128k instruct Q4 K M
Phi · seawolf2357
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 mini 4k instruct text to sql
Phi · ThePromptKing
Params3.82B
Context4K
Smallest2.3 GB
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Novel Regen
Phi · AkashMnd
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi Fi Fo
Phi · passthepizza
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Chinese
Phi · Cran-May
Params3.82B
Context128K
Smallest2.8 GB
PH
phi 4 Q2 K
Phi · matrixportalx
Params14.7B
Context16K
Smallest5.5 GB
PH
phi3 mini rebus solver Q8 0
Phi · gsarti
Params3.82B
Context4K
Smallest4.1 GB
PH
ihughes15234 phi35 tictactoe dpo10epoch v6
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
MaziyarPanahi calme 2.2 phi3 4b
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
gmh98 phi3 medical del ltr
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
joke finetome model gguf phi4 20260111 081117
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
Phi 3 medium 128k instruct Q5 0
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
PH
AXCXEPT Borea Phi 3.5 Mini Instruct Jp
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · Hongrulee
Params3.82B
Context128K
Q4_K_M2.3 GB