Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 4 Deepseek R1 Distilled 16bit v2
Phi · ykarout
Params14.7B
Context16K
Q4_K_M10.2 GB
PH
Phi 2 Orange v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
AeroMind Phi4 mini
Phi · Kami574
Params3.84B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 2 Audio Super
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi medprob medicine i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 mini dare ties
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Empathetic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini Instruct
Phi · CelesteImperia
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
elliotthwang phi 2 zh
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 RP V0.2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi3 lora ktomixen post sft mathinstruct lima partial i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Bioinspired Phi 3 mini 4k
Phi · lamm-mit
Params3.82B
Context4K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct
Phi · pprp
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4 MPOA experiment
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 3.5 Sakura Yuzu v1.5
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
UNCENSORED Wukong Phi 3 Instruct Ablated Q4 K M
Phi · v8karlo
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 1 5
Phi · tensorblock
Params1.42B
Context2K
Smallest0.6 GB
PH
lumynax infused phi 4 text
Phi · AbteeXAILab
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Abliterated
Phi · Justbackup
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 3 medium 128k iq
Phi · neody
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3.1 mini 4k instruct
Phi · SandLogicTechnologies
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · narainp
Params3.82B
Context4K
Q4_K_M4.8 GB
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Mini Instruct
Phi · llmware
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi4 RP o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
ihughes15234 phi35 tictactoe dpo firstonly 2epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 2 orange
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB