Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
MaheshKumarK phi3instructwithcontext
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Goru
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB
PH
Phi 3 song lyrics 1.0 GGUF IQ Imatrix Request
Phi · LWDCLS
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 4 function calling
Phi · ariel-pillar
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
mudler.LocalAI functioncall phi 4 v0.3
Phi · DevQuasar-7
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Amod Phi 3 mini quote planName SFT PLNYRv2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
gguf sharded phi 2 orange v2
Phi · Felladrin
Params2.78B
Context2K
Smallest2.0 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phinance
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Instruct Eco Bioaligned i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
vince62s phi 2 psy
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
saiga phi 3 mini 4k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 medium 4k instruct abliterated v3
Phi · failspy
Params14B
Context4K
Smallest6.9 GB
PH
phi 3 mini 4k python
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
anakin87 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3 merged FinetunedByAG
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
bunnycore Phi 3.5 Mini ChatML
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 mini 4k instruct GGUF v3
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · mackkkkkilllll
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi3 4x4b v1 i1
Phi · mradermacher
Params11.1B
Context4K
Q4_K_M6.7 GB
PH
alexshengzhili phi3 dpo 0907 preference iclr2023
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 reasoning vision 15B
Phi · jamesburton
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
CHATPRG v1.2 Phi 3.5 mini instruct
Phi · jhangmez
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
siddhant7876 phi3.5 dpo
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
elisa chan phi 2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
abhinav2024 phi 3.5 instruct merged vul
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Megatron Empathetic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi3 medium 4k
Phi · nisten
Params14B
Context4K
Smallest7.5 GB
PH
Phi 1.5_paperclipmaximizer_v2
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Candle phi 2 old
Phi · DanielClough
Params2.78B
Context—
Smallest0.9 GB