Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 2
Phi · DhruvalLabs
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
IntelLabs sqft phi 3 mini 4k 60 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
amod plnyr Phi 3.5 mini quote planName SFT PLNYR
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 super i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Super o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
bunnycore Phi 3.5 Mini Sonet RP V2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
Roleplay
PH
Orca_Mini_Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Genuine Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 mini instruct 24 9 29 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi3 lora sft mathinstruct lima
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
dolphin 2 6 phi 2
Phi · buachaill78
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use
PH
myfi parser phi 3.5 mini instruct epochs 4
Phi · RichardErkhov
Params3.82B
Context8K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 RR Shoup
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 4k mini ussd finetuned
Phi · Aurumdev95
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 4B 4k Instruct CMC
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 50 cs heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
jcorte real phi35 pd kb lora model
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 2 pruned50
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 4k instruct LASER
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi-3-sql
Phi · omeryentur
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
rasyosef Phi 1 5 Instruct v0.1
Phi · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PH
microsoft Phi 3 medium 4k instruct GGUF smashed
Phi · PrunaAI
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
disi unibo nlp phi3 SFT medqa triples cot
Phi · RichardErkhov
Params3.82B
Context16K
Q4_K_M2.3 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 40 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
g ronimo phi 2 OpenHermes 2.5
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
Phi 3 medium 4k instruct
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 mini 128k instruct abliterated v3
Phi · failspy
Params3.82B
Context128K
Smallest2.4 GB
GGUF
PH
Phi 4 Mini Instruct DSpark
Phi · rasyosef
Params658M
Context128K
Smallest0.7 GB
Tool use

Keep browsing