Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 Q5 K M
Phi · jacobcarajo
Params14.7B
Context16K
Smallest10.6 GB
Coding
PH
ifai promptmkr dolphin phi3
Phi · impactframes
Params6.54B
Context4K
Smallest4.1 GB
GGUF
PH
Phi-4-Mini-Reasoning
Phi · SandLogicTechnologies
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 3.5 mini dare ties Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi35 pd dpo10epoch 1200
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
lumynax infused phi3 mini 4k
Phi · AbteeXAILab
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
OpenZero Ouroboros 3.8B
Phi · shafire
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 4 Reasoning Vision 15B
Phi · gaoqianshen
Params14.7B
Context32K
Q4_K_M9.1 GB
ReasoningVision
PH
Phi 3 medium 4k instruct
Phi · LoneStriker
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
ablation 29 rafathenev2.phi4 shisa v2 phi 4 14b
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 medium 128k instruct Q5 K S
Phi · CHE-72
Params14B
Context128K
Smallest9.6 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi Line_14B
Phi · RedSQID
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Samantha2.0 Phi4 ita 16bit
Phi · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
GGUF
PH
Phi mts dialogue clinical note PASTMEDICALHX i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi-3-mini-text2SQL-4k-instruct-GGUF-f16
Phi · dmedhi
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · HugoVoxx
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 mini Instruct chinese couplet
Phi · hextecheart
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
therapy phi3
Phi · Daizee
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
EEVE Korean 2.8B v1.0 Q8 0
Phi · andreass123
Params2.82B
Context2K
Smallest3.0 GB
GGUF
PH
Phi 3 mini 128k instruct abliterated v3 Q5 K S
Phi · Chaliece
Params3.82B
Context128K
Smallest2.6 GB
Coding
PH
Phi 4 Mini Instruct
Phi · BryanKohler
Params3.84B
Context128K
Smallest3.2 GB
CodingTool use
PH
flow mint 20250824 175011
Phi · devparagiri
Params2.77B
Context2K
Smallest3.0 GB
GGUF
PH
Circuit
Phi · rudranshjoshi
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 2 OpenHermes 2.5 v2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
Phi3.5 Q8
Phi · farikaw599
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Covid Chatbot Phi2 Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · jc-builds
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
phi 2 super
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
microsoft phi 4 mini instruct
Phi · Shiv12A
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use

Keep browsing