Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 4 ColdBrew 14B Intrepid
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Mini Flash Telecom Campaign acton
Phi · azizshaw
Params3.84B
Context128K
Smallest7.7 GB
PH
Phi 4 Reasoning Plus
Phi · IWasBorn3D
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Mermaid Phi 3 medium 128k instruct 14B Q8 0
Phi · danielus
Params14B
Context128K
Smallest14.8 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · huzunali
Params3.82B
Context128K
Smallest4.1 GB
PH
phi3-lobbying-gguf-q8
Phi · twright8
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · pmathis89
Params3.82B
Context4K
Smallest4.1 GB
PH
slim xsum phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Trim
Phi · mradermacher
Params6.14B
Context16K
Q4_K_M3.8 GB
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Smallest2.1 GB
PH
PHI3STRAN 128K ITA V.0.1 Q5 K M
Phi · Antonio88
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct
Phi · space1panda
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · nulledinstance
Params3.82B
Context128K
Smallest3.1 GB
PH
Phi3 AlphaSquare
Phi · Almanships
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Test Phi2
Phi · PSM24
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
PH
magnifi Phi3 intent v37 3 wo unknown 3 lr 0.002 r 16 a 8
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 1 Q2 K
Phi · TheOSExplorer
Params1.42B
Context2K
Smallest0.6 GB
PH
finetuned phi3
Phi · alam1n
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
dcm_QUANTIZED
Phi · netaicsco
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
mt guard 4g r1241 5FjVGEKt
Phi · microtensor-archive
Params3.84B
Context128K
Smallest2.1 GB
PH
phi mini 3100
Phi · Sahil2507
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
ondevicellm phi 1 5 sft
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3 mini 4k instruct
Phi · mardakani
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi4 Model07
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Classification
Phi · olusegunola
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
German RAG PHI 3.5 MINI 4B ORPO HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 MoE Instruct
Phi · sheldonrobinson
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
phi bode 2 ultraalpaca Q5 K M
Phi · noxinc
Params2.78B
Context2K
Smallest2.0 GB