Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 4 Q5 K M
Phi · jacobcarajo
Params14.7B
Context16K
Smallest10.6 GB
PH
ifai promptmkr dolphin phi3
Phi · impactframes
Params6.54B
Context4K
Smallest4.1 GB
PH
Phi-4-Mini-Reasoning
Phi · SandLogicTechnologies
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 mini dare ties Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ihughes15234 phi35 pd dpo10epoch 1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
lumynax infused phi3 mini 4k
Phi · AbteeXAILab
Params3.82B
Context4K
Smallest2.4 GB
PH
OpenZero Ouroboros 3.8B
Phi · shafire
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Reasoning Vision 15B
Phi · gaoqianshen
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3 medium 4k instruct
Phi · LoneStriker
Params14B
Context4K
Q4_K_M8.6 GB
PH
ablation 29 rafathenev2.phi4 shisa v2 phi 4 14b
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 medium 128k instruct Q5 K S
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi Line_14B
Phi · RedSQID
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Samantha2.0 Phi4 ita 16bit
Phi · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
PH
Phi mts dialogue clinical note PASTMEDICALHX i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi-3-mini-text2SQL-4k-instruct-GGUF-f16
Phi · dmedhi
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · HugoVoxx
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 mini Instruct chinese couplet
Phi · hextecheart
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
therapy phi3
Phi · Daizee
Params3.82B
Context4K
Smallest2.2 GB
PH
EEVE Korean 2.8B v1.0 Q8 0
Phi · andreass123
Params2.82B
Context2K
Smallest3.0 GB
PH
Phi 3 mini 128k instruct abliterated v3 Q5 K S
Phi · Chaliece
Params3.82B
Context128K
Smallest2.6 GB
PH
Phi 4 Mini Instruct
Phi · BryanKohler
Params3.84B
Context128K
Smallest3.2 GB
PH
flow mint 20250824 175011
Phi · devparagiri
Params2.77B
Context2K
Smallest3.0 GB
PH
Circuit
Phi · rudranshjoshi
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 2 OpenHermes 2.5 v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi3.5 Q8
Phi · farikaw599
Params3.82B
Context128K
Smallest4.1 GB
PH
Covid Chatbot Phi2 Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Reasoning
Phi · jc-builds
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 2 super
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
microsoft phi 4 mini instruct
Phi · Shiv12A
Params3.84B
Context128K
Q4_K_M2.5 GB