Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 2 chat
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
phi 4
Phi · DhruvalLabs
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi2 Humanizer Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
LocalAI functioncall phi 4 v0.3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 3.1 qlora blend dpo abliterated i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Mid
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
rhaymison phi 3 portuguese tom cat 4k instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 3 clinical
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Meditron3 Phi4 14B i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
sujithatz finbot phi 3.5 mini instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 MoE Instruct
Phi · lmstudio-community
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
R3 Phi 4 Reasoning Plus LoRA 14k
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3 mini 4k instruct
Phi · mzwing
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
calme-2.1-phi3.5-4b
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 2 psy
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 RP V0.2 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
bunnycore Phi 2 OmniMatrix
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
TutorAI Chemistry Phi4
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · cowoho
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Huihui Ai Phi 4 Mini Instruct Abliterated
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
PH
Phi 4 Uncensored i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Medium 4k Instruct
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
PH
dolphin 2 6 phi 2 candle
Phi · Demonthos
Params2.78B
Context—
Smallest1.6 GB
PH
gguf sharded Phi 3 mini 4k instruct
Phi · Felladrin
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · Connor2m
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 1 5 i1
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
microsoft Phi 3 mini 4k instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB