Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · worthdoing
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct Abliterated
Phi · PJRM
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
DeepThinkers Phi4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
ScholasticLogicAI Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Llava Phi 3 Mini Xtuner
Phi · faceradix
Params3.82B
Context4K
Q4_K_M2.3 GB
Vision
PH
lucapopescu phi3 unit tester
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 mini obliterated
Phi · ArRENCEAI
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
joke finetome model gguf phi4 20260111 113458
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
Stoicism1 Phi3.5 mini instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct gguf
Phi · femijoshuaalabi
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · WorkOffline
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 mini 128k instruct Q6 K
Phi · CHE-72
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
ihughes15234 phi35 kp dpo1epoch 1e6lr
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Haesteining.Phi3smallv5
Phi · DevQuasar-3
Params5.63B
Context128K
Q4_K_M3.5 GB
GGUF
PH
Phi 4 Mirage Sol Reasoning 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 3 mini 128k instruct Q4 K M
Phi · seawolf2357
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct text to sql
Phi · ThePromptKing
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Novel Regen
Phi · AkashMnd
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi Fi Fo
Phi · passthepizza
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Chinese
Phi · Cran-May
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
phi 4 Q2 K
Phi · matrixportalx
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
phi3 mini rebus solver Q8 0
Phi · gsarti
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo10epoch v6
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
MaziyarPanahi calme 2.2 phi3 4b
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
gmh98 phi3 medical del ltr
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
joke finetome model gguf phi4 20260111 081117
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
Phi 3 medium 128k instruct Q5 0
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
Coding
PH
AXCXEPT Borea Phi 3.5 Mini Instruct Jp
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · Hongrulee
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing