Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 3 mini 4k instruct extra helpfull
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi mts dialogue clinical note PASTMEDICALHX
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Samanta NewGenesis Phi4 DPO
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2 logical sft
Phi · mradermacher
Params2.78B
Context4K
Q4_K_M1.7 GB
Reasoning
PH
Einstein v6.1 phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
calme 2.2 phi3 4b
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
LocalAI functioncall phi 4 v0.3 Q4 K M
Phi · LocalAI-io
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
rasyosef phi 2 instruct v0.2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini Mango 1
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
kittylm phi 4 mini
Phi · KittyLM
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Instruct Abliterated
Phi · LWDCLS
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi4 mini browser
Phi · KelvinK4931B
Params3.84B
Context128K
Smallest2.5 GB
Tool use
PH
Phi medquad symptoms
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
GGUF
PH
Phi 2 Scientific Papers Base v0.1
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
1995Austin phi 3.5 tuning decomposer
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
MediPhi-Instruct
Phi · Mungert
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
TOI 157 Phi 4 Reasoning Mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
R3 Phi 4 Reasoning Plus 14k
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3 Medium 128k Instruct
Phi · ogiwrghs
Params14B
Context128K
Smallest5.1 GB
GGUF
PH
Phi 3 mini 4k instruct V2
Phi · AI-Engine
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
AURA Eve Tactical Instruct 3.8B
Phi · JeffTheNerdDev96
Params3.84B
Context128K
Smallest2.5 GB
Coding
PH
microsoft Phi 3 medium 128k instruct GGUF smashed
Phi · PrunaAI
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
showvikdbz phi 3.5 10k teacher 4o 05 13
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi3 3.5 OH SFT Avg
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2
Phi · rob-x-ai
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
Phi 4 Reasoning
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Sayan01/Phi3-TL-ORCAMEL-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing