Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Unaligned Thinker PHI 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
phi 1
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
phi 3 matt medicine i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3 mini 4k loudai
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 ColdBrew 14B Intrepid
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi Stoma
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
GGUF
PH
Phi 4 Stock RP i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Psychologist Bot
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
rasyosef phi 2 sft openhermes 128k v2 merged
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
R3 Phi 4 Reasoning Plus LoRA 5K v1.1
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 4 Reasoning Plus
Phi · mmnga
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Einstein v4 phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
CodingTool use
PH
Phi 3.5 Health Chatbot i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
LocalAI functioncall phi 4 v0.1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
ReWiz Phi 4 14B
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi Tiny MoE
Phi · tripathyShaswata
Params3.76B
Context4K
Smallest4.0 GB
GGUF
PH
phi 4 45b i1
Phi · mradermacher
Params45.3B
Context16K
Q4_K_M27.8 GB
GGUF
PH
Phi 4 Open R1 Distill EZOv1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
Phi-4-Argunaut-1-HIRPO
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
ReasoningTool use
PH
phi3.5 hallucination judge merge i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
CANBERT phi3 full context
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
calme 2.2 phi3 4b i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
ihughes15234 phi 3 5 mini 10k con4 bthrough
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi4mini nerc cip
Phi · awb25
Params3.84B
Context128K
Smallest7.7 GB
Tool use
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params2.92B
Context4K
Q4_K_M1.8 GB
GGUF

Keep browsing