Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi3 Sysadmin
Phi · lalatendu
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
ihughes15234 phi 3 mini 500 combined 4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
microsoft.Phi 4 Reasoning
Phi · DevQuasar
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
sqft sparsepeft phi 3 mini 4k 50 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · tatsuyaaaaaaa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Catholic Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
ScholasticLogicAI Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · xaskasdf
Params14B
Context128K
Smallest3.2 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Melvin56
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
bunnycore Phi 3.5 Mini Sonet RP
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
Roleplay
PH
Phi 4 RStock v0.1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
FactAlign Phi 3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · gaianet
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
phi 2
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
bunnycore Phi 3.5 mini TitanFusion 0.4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Models Ykarout Phi4 Reasoning Merged
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
Reasoning
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3.5 Mini Instruct CPT D1_chosen Dpo Mix Shuffled5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Orange v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Dolphin 2.9.1 Phi 3 Kensho 4.5B
Phi · mradermacher
Params6.54B
Context4K
Q4_K_M4.0 GB
CodingTool use
PH
Phi 3 medium 4k instruct
Phi · gaianet
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
failspy Phi 3 mini 4k geminified
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
fractalego wafl phi3.5 mini instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
win10 Phi 3.5 mini instruct 24 9 29
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Delthanar
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing