Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3.5 mini TitanFusion 0.1 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct LoRA 32
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
edumunozsala phi3 mini 4k qlora python code 20k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3.5 Mini Instruct
Phi · AcerTest359
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 2
Phi · second-state
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi2 haiku ita v0.2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 3.1 qlora blend dpo abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
microsoft/Phi-4-reasoning-vision-15B
Phi · dranger003
Params14.7B
Context32K
Smallest9.7 GB
PH
dolphin 2 6 phi 2 oasst2 chatML V2
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · codegood
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
LocalAI functioncall phi 4 v0.2 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi Delthanar i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 medium 128k instruct
Phi · thesven
Params14B
Context128K
Q4_K_M8.6 GB
PH
microsoft phi 4 GGUF Q4 K M
Phi · sigmanih
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
PH
Phinance
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
PH
GRAG PHI 3.5 MINI 4B MERGED HESSIAN AI i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
IntelLabs sqft phi 3 mini 4k 50 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
phi 4
Phi · QuantFactory
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
microsoft phi 2 trained abliterated QA 1960 all modules merged i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Reasoning Vision 15B ROCmFPX Q8 0 AGENT
Phi · kingjones777
Params14.7B
Context32K
Smallest15.4 GB
PH
ihughes15234 phi35 tictactoe dpo5epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 RP v0 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 4 reasoning
Phi · cortexso
Params3.84B
Context128K
Q4_K_M2.5 GB