Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
MaheshKumarK phi3instructwithcontext
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Goru
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB
GGUF
PH
Phi 3 song lyrics 1.0 GGUF IQ Imatrix Request
Phi · LWDCLS
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 4 function calling
Phi · ariel-pillar
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
mudler.LocalAI functioncall phi 4 v0.3
Phi · DevQuasar-7
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Amod Phi 3 mini quote planName SFT PLNYRv2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
gguf sharded phi 2 orange v2
Phi · Felladrin
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phinance
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Instruct Eco Bioaligned i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
vince62s phi 2 psy
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
saiga phi 3 mini 4k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct abliterated v3
Phi · failspy
Params14B
Context4K
Smallest6.9 GB
Coding
PH
phi 3 mini 4k python
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
PH
anakin87 Phi 3.5 mini ITA
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3 merged FinetunedByAG
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
bunnycore Phi 3.5 Mini ChatML
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 4k instruct GGUF v3
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · mackkkkkilllll
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi3 4x4b v1 i1
Phi · mradermacher
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
PH
alexshengzhili phi3 dpo 0907 preference iclr2023
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 reasoning vision 15B
Phi · jamesburton
Params14.7B
Context32K
Q4_K_M9.1 GB
ReasoningVision
PH
CHATPRG v1.2 Phi 3.5 mini instruct
Phi · jhangmez
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
siddhant7876 phi3.5 dpo
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
elisa chan phi 2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
abhinav2024 phi 3.5 instruct merged vul
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Megatron Empathetic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3 medium 4k
Phi · nisten
Params14B
Context4K
Smallest7.5 GB
GGUF
PH
Phi 1.5_paperclipmaximizer_v2
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Candle phi 2 old
Phi · DanielClough
Params2.78B
Context—
Smallest0.9 GB
GGUF

Keep browsing