Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi3 Sysadmin
Phi · lalatendu
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
ihughes15234 phi 3 mini 500 combined 4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
microsoft.Phi 4 Reasoning
Phi · DevQuasar
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
sqft sparsepeft phi 3 mini 4k 50 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning
Phi · tatsuyaaaaaaa
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Catholic Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Q4_K_M7.3 GB
PH
ScholasticLogicAI Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Medium 128k Instruct
Phi · xaskasdf
Params14B
Context128K
Smallest3.2 GB
PH
Phi 4 Mini Instruct
Phi · Melvin56
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
bunnycore Phi 3.5 Mini Sonet RP
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 RStock v0.1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
FactAlign Phi 3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 MoE Instruct
Phi · gaianet
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
phi 2
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
bunnycore Phi 3.5 mini TitanFusion 0.4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Models Ykarout Phi4 Reasoning Merged
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3.5 Mini Instruct CPT D1_chosen Dpo Mix Shuffled5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 2 Orange v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Dolphin 2.9.1 Phi 3 Kensho 4.5B
Phi · mradermacher
Params6.54B
Context4K
Q4_K_M4.0 GB
PH
Phi 3 medium 4k instruct
Phi · gaianet
Params14B
Context4K
Q4_K_M8.6 GB
PH
failspy Phi 3 mini 4k geminified
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
fractalego wafl phi3.5 mini instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
win10 Phi 3.5 mini instruct 24 9 29
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi Delthanar
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB