Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 mini TitanFusion 0.1 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct LoRA 32
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
edumunozsala phi3 mini 4k qlora python code 20k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 3.5 Mini Instruct
Phi · AcerTest359
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 2
Phi · second-state
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
phi2 haiku ita v0.2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3.1 qlora blend dpo abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
microsoft/Phi-4-reasoning-vision-15B
Phi · dranger003
Params14.7B
Context32K
Smallest9.7 GB
ReasoningVision
PH
dolphin 2 6 phi 2 oasst2 chatML V2
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · codegood
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
LocalAI functioncall phi 4 v0.2 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi Delthanar i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
GGUF
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 3 medium 128k instruct
Phi · thesven
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
microsoft phi 4 GGUF Q4 K M
Phi · sigmanih
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · calcuis
Params3.82B
Context128K
Q4_K_M2.2 GB
GGUF
PH
Phinance
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
CodingTool use
PH
GRAG PHI 3.5 MINI 4B MERGED HESSIAN AI i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
IntelLabs sqft phi 3 mini 4k 50 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Reasoning
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoningTool use
PH
phi 4
Phi · QuantFactory
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
microsoft phi 2 trained abliterated QA 1960 all modules merged i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Reasoning Vision 15B ROCmFPX Q8 0 AGENT
Phi · kingjones777
Params14.7B
Context32K
Smallest15.4 GB
ReasoningVision
PH
ihughes15234 phi35 tictactoe dpo5epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 RP v0 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Roleplay
PH
phi 4 reasoning
Phi · cortexso
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use

Keep browsing