Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 4 COT
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 2 OpenHermes 2.5 v2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Reasoning Heretic
Phi · Ishowbackup
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
bunnycore Phi 3.5 mini TitanFusion 0.3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
disi unibo nlp phi3 SFT medmcqa triples cot
Phi · RichardErkhov
Params3.82B
Context16K
Q4_K_M2.3 GB
PH
ihughes15234 phi35 kp dpo5epoch total
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 4 Q4 K M
Phi · itlwas
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Health CoT 1.1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · macadeliccc
Params14B
Context4K
Q4_K_M8.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ihughes15234 phi35 tictactoe dpo1epoch v5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
OpenZero SkyPilot 3.8B
Phi · shafire
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Damysus 2.7B Chat
Phi · prince-canuma
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Candle phi 1
Phi · DanielClough
Params1.42B
Context—
Smallest0.5 GB
PH
bunnycore Phi 3.5 Mini Hyper
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix_Skywork_Infinity
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
EdgeRunner Command AgentF phi4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 2 OpenHermes 2.5
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi medquad research i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
sqft sparsepeft phi 3 mini 4k 60 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
ihughes15234 phi35 kp dpo3epoch v2 1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
SauerkrautLM Phi 3 Medium
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
PH
phi3 prompt engineer
Phi · KRAFTYUX
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
omega coder phi 3 mini 1K
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Empathetic
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
PH
Phi 3.5 mini 32K output
Phi · FalconNet
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k geminified IQ4 NL
Phi · hellork
Params3.82B
Context4K
Smallest2.2 GB
PH
Phi4 MedIT 10B O1
Phi · mradermacher
Params10.3B
Context16K
Q4_K_M6.2 GB
PH
Obelix Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB