Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 2 Layla v1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 2 Orange v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Maika Buddy 3B8 Phi3 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Amu orpo lora phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
llava phi 2
Phi · kejcao
Params2.78B
Context2K
Q4_K_M1.7 GB
Vision
PH
Meditron3 Phi4 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
DZ TDPO Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · tensorblock
Params14B
Context128K
Smallest5.1 GB
Coding
PH
Phi4 Mini Prose2Tags 4B
Phi · USS-Inferprise
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Small
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
MrOvkill Phi 3 Instruct Bloated
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
minghaowu phi 2 OpenHermes 2.5
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
prhegde merge aanaphi phi2 orage 3b
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 Slerp2 14B
Phi · mradermacher
Params14B
Context16K
Q4_K_M8.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q6 K
Phi · newsletter
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Satandon1999 phi3 mini context ignore
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · musaamadni01
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
phi3
Phi · FL33TW00D-HF
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct QG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi 3 mini 500 combined 3
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context8K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Felladrin
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
Phi 3 4B 4k Instruct MBLC
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Tiny Random Phi3ForCausalLM
Phi · RichardErkhov
Params2M
Context4K
Q4_K_M0.0 GB
GGUF
PH
phi3 stellargalaxy8 merged
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
bunnycore Phi 3.5 mini TitanFusion 0.1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing