Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
ihughes15234 phi 3 5 mini 20k con4 bthrough parmdiff
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Calme 2.1 Phi3 4b
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 4 unslothed lora
Phi · sugatoray
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Microsoft Phi 4 Mini Reasoning
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 2 Layla v1 Chatml
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 3 matt medicine
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Ektome Phi 3.5 mini i PristinelyUncensored
Phi · Zynerji
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi2 sqlcoder
Phi · pavankumarbalijepalli
Params2.78B
Context2K
Smallest5.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · liodon-ai
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 instruct CBR Bonds info
Phi · winterForestStump
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi4_Sql_Finetuned
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
gguf Q5 K M Phi 1 5 Instruct v0.1
Phi · Felladrin
Params1.41B
Context2K
Smallest1.0 GB
PH
phi 2 instruct
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
ankit011 phi 2 code
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 2 DLEC i1
Phi · mradermacher
Params3.25B
Context2K
Q4_K_M2.0 GB
PH
Phi4.Turn.R1Distill.16bit i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 mini TitanFusion 0.6
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning Heretic
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi4 Toxic Lora Merged
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 2
Phi · nold
Params2.78B
Context2K
Smallest1.9 GB
PH
Phi 3 mini 4k instruct June2024 Q6 K
Phi · RachidAR
Params3.82B
Context4K
Smallest3.1 GB
PH
Phi 3.5 Mini Instruct
Phi · redhat6
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4 deepseek r1 distilled latest
Phi · ykarout
Params14.7B
Context16K
Q4_K_M9.7 GB
PH
Phi 4 Mini Reasoning Abliterated
Phi · dev-196
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
PH
microsoft phi 2 pytdml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 3 mini 128k italian v2 Q4 K M chunked
Phi · BoscoTheDog
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
microsoft Phi 3.5 mini instruct fine tuned by yahma alpaca cleaned
Phi · hali52441
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Sakura Yuzu v1.5
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB