Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 2
Phi · DhruvalLabs
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
IntelLabs sqft phi 3 mini 4k 60 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
amod plnyr Phi 3.5 mini quote planName SFT PLNYR
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 2 super i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Super o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
bunnycore Phi 3.5 Mini Sonet RP V2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Orca_Mini_Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Genuine Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 mini instruct 24 9 29 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3 lora sft mathinstruct lima
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
dolphin 2 6 phi 2
Phi · buachaill78
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
myfi parser phi 3.5 mini instruct epochs 4
Phi · RichardErkhov
Params3.82B
Context8K
Q4_K_M2.3 GB
PH
Phi 4 RR Shoup
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 4k mini ussd finetuned
Phi · Aurumdev95
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 4B 4k Instruct CMC
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 50 cs heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
jcorte real phi35 pd kb lora model
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 2 pruned50
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 mini 4k instruct LASER
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi-3-sql
Phi · omeryentur
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
rasyosef Phi 1 5 Instruct v0.1
Phi · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
PH
microsoft Phi 3 medium 4k instruct GGUF smashed
Phi · PrunaAI
Params14B
Context4K
Q4_K_M8.6 GB
PH
disi unibo nlp phi3 SFT medqa triples cot
Phi · RichardErkhov
Params3.82B
Context16K
Q4_K_M2.3 GB
PH
sqft sparsepeft phi 3 mini 4k 40 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
g ronimo phi 2 OpenHermes 2.5
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 medium 4k instruct
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 mini 128k instruct abliterated v3
Phi · failspy
Params3.82B
Context128K
Smallest2.4 GB
PH
Phi 4 Mini Instruct DSpark
Phi · rasyosef
Params658M
Context128K
Smallest0.7 GB