Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 COT
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2 OpenHermes 2.5 v2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
Phi 4 Mini Reasoning Heretic
Phi · Ishowbackup
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
bunnycore Phi 3.5 mini TitanFusion 0.3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
disi unibo nlp phi3 SFT medmcqa triples cot
Phi · RichardErkhov
Params3.82B
Context16K
Q4_K_M2.3 GB
GGUF
PH
ihughes15234 phi35 kp dpo5epoch total
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q4 K M
Phi · itlwas
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 Health CoT 1.1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
dolphin-2.9.2-Phi-3-Medium
Phi · macadeliccc
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo1epoch v5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
OpenZero SkyPilot 3.8B
Phi · shafire
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Damysus 2.7B Chat
Phi · prince-canuma
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Candle phi 1
Phi · DanielClough
Params1.42B
Context—
Smallest0.5 GB
GGUF
PH
bunnycore Phi 3.5 Mini Hyper
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix_Skywork_Infinity
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
EdgeRunner Command AgentF phi4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi 2 OpenHermes 2.5
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
Phi medquad research i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 60 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi35 kp dpo3epoch v2 1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
SauerkrautLM Phi 3 Medium
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
phi3 prompt engineer
Phi · KRAFTYUX
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
omega coder phi 3 mini 1K
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Empathetic
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
GGUF
PH
Phi 3.5 mini 32K output
Phi · FalconNet
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k geminified IQ4 NL
Phi · hellork
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi4 MedIT 10B O1
Phi · mradermacher
Params10.3B
Context16K
Q4_K_M6.2 GB
Coding
PH
Obelix Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing