Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
nbeerbower phi3.5 gutenberg 4B
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Uncensored
Phi · ccharnkij
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
CoLoR Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3 Goru i1
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB
PH
crisp im mirage phi3 instruct rank
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 30 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 mini TitanFusion 0.2
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
g ronimo phi 2 OpenHermes 2.5 v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 40 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 2 Layla v1
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi4 MoE 2x14B Instruct
Phi · mradermacher
Params14.2B
Context16K
Q4_K_M24.8 GB
PH
Phi 4 Reasoning
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
phi3 merged FinetunedByAG i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Hyper Mix
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
1995Austin phi 3.5 tuning decomposer v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
lllyasviel omost phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
milandean Phi 3.5 mini
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · xaskasdf
Params3.82B
Context128K
Smallest1.8 GB
PH
phi 2 super
Phi · sayhan
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · Alcoft
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Microsoft Phi 4 Heretic
Phi · ThalisAI
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
JiaweiGuo123 microsoft phi 2 fine tune alpaca chinese merged model
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi3 4x4b v1
Phi · mradermacher
Params11.1B
Context4K
Q4_K_M6.7 GB
PH
LLaVA Phi 3 mini 4k instruct
Phi · dragonSwing
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Infinity Mid3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB