Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 2 Layla v1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 2 Orange v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Maika Buddy 3B8 Phi3 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Amu orpo lora phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
llava phi 2
Phi · kejcao
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Meditron3 Phi4 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
DZ TDPO Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Medium 128k Instruct
Phi · tensorblock
Params14B
Context128K
Smallest5.1 GB
PH
Phi4 Mini Prose2Tags 4B
Phi · USS-Inferprise
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Small
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
MrOvkill Phi 3 Instruct Bloated
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
minghaowu phi 2 OpenHermes 2.5
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
prhegde merge aanaphi phi2 orage 3b
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi4 Slerp2 14B
Phi · mradermacher
Params14B
Context16K
Q4_K_M8.6 GB
PH
Phi 3 mini 128k instruct Q6 K
Phi · newsletter
Params3.82B
Context128K
Smallest3.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Satandon1999 phi3 mini context ignore
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · musaamadni01
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi3
Phi · FL33TW00D-HF
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 Mini 128k Instruct QG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ihughes15234 phi 3 mini 500 combined 3
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context8K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · Felladrin
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3 4B 4k Instruct MBLC
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Tiny Random Phi3ForCausalLM
Phi · RichardErkhov
Params2M
Context4K
Q4_K_M0.0 GB
PH
phi3 stellargalaxy8 merged
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
bunnycore Phi 3.5 mini TitanFusion 0.1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB