Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
nbeerbower phi3.5 gutenberg 4B
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Uncensored
Phi · ccharnkij
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
CoLoR Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3 Goru i1
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB
GGUF
PH
crisp im mirage phi3 instruct rank
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 30 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.2
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
g ronimo phi 2 OpenHermes 2.5 v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 40 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Layla v1
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 MoE 2x14B Instruct
Phi · mradermacher
Params14.2B
Context16K
Q4_K_M24.8 GB
GGUF
PH
Phi 4 Reasoning
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
phi3 merged FinetunedByAG i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Hyper Mix
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
1995Austin phi 3.5 tuning decomposer v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
lllyasviel omost phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
milandean Phi 3.5 mini
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · xaskasdf
Params3.82B
Context128K
Smallest1.8 GB
GGUF
PH
phi 2 super
Phi · sayhan
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Alcoft
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Microsoft Phi 4 Heretic
Phi · ThalisAI
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
JiaweiGuo123 microsoft phi 2 fine tune alpaca chinese merged model
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi3 4x4b v1
Phi · mradermacher
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
PH
LLaVA Phi 3 mini 4k instruct
Phi · dragonSwing
Params3.82B
Context4K
Q4_K_M2.3 GB
Vision
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Mid3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing