Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 ColdBrew 14B Intrepid
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Mini Flash Telecom Campaign acton
Phi · azizshaw
Params3.84B
Context128K
Smallest7.7 GB
Tool use
PH
Phi 4 Reasoning Plus
Phi · IWasBorn3D
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Mermaid Phi 3 medium 128k instruct 14B Q8 0
Phi · danielus
Params14B
Context128K
Smallest14.8 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · huzunali
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
phi3-lobbying-gguf-q8
Phi · twright8
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · pmathis89
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
slim xsum phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 Trim
Phi · mradermacher
Params6.14B
Context16K
Q4_K_M3.8 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Smallest2.1 GB
Tool use
PH
PHI3STRAN 128K ITA V.0.1 Q5 K M
Phi · Antonio88
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · space1panda
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · nulledinstance
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
Phi3 AlphaSquare
Phi · Almanships
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Test Phi2
Phi · PSM24
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B MERGED HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
Reasoning
PH
magnifi Phi3 intent v37 3 wo unknown 3 lr 0.002 r 16 a 8
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 1 Q2 K
Phi · TheOSExplorer
Params1.42B
Context2K
Smallest0.6 GB
Coding
PH
finetuned phi3
Phi · alam1n
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
dcm_QUANTIZED
Phi · netaicsco
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
mt guard 4g r1241 5FjVGEKt
Phi · microtensor-archive
Params3.84B
Context128K
Smallest2.1 GB
Tool use
PH
phi mini 3100
Phi · Sahil2507
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
ondevicellm phi 1 5 sft
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · mardakani
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi4 Model07
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Classification
Phi · olusegunola
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B ORPO HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
Reasoning
PH
Phi 3.5 MoE Instruct
Phi · sheldonrobinson
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
phi bode 2 ultraalpaca Q5 K M
Phi · noxinc
Params2.78B
Context2K
Smallest2.0 GB
GGUF

Keep browsing