Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 2 chat
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
phi 4
Phi · DhruvalLabs
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi2 Humanizer Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
LocalAI functioncall phi 4 v0.3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 3.1 qlora blend dpo abliterated i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Mid
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
rhaymison phi 3 portuguese tom cat 4k instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 3 clinical
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Meditron3 Phi4 14B i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
sujithatz finbot phi 3.5 mini instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · lmstudio-community
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
R3 Phi 4 Reasoning Plus LoRA 14k
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3 mini 4k instruct
Phi · mzwing
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 psy
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 RP V0.2 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
bunnycore Phi 2 OmniMatrix
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
TutorAI Chemistry Phi4
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · cowoho
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Huihui Ai Phi 4 Mini Instruct Abliterated
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
Phi 4 Uncensored i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
dolphin 2 6 phi 2 candle
Phi · Demonthos
Params2.78B
Context—
Smallest1.6 GB
GGUF
PH
gguf sharded Phi 3 mini 4k instruct
Phi · Felladrin
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Connor2m
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 1 5 i1
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
microsoft Phi 3 mini 4k instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing