Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
Flow Judge v0.1
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Wukong Phi 3 Instruct Ablated i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 200 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · kenonix
Params3.84B
Context128K
Smallest2.8 GB
CodingTool use
PH
ryota39 Phi 3 mini 4k instruct dpo
Phi · mmnga
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
duy nq phi 3 mini 4k merge v4
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 2 psy
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
CleverBoi Phi 3.5 mini instruct
Phi · theprint
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 30 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Avg i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · MoMonir
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
dbands Phi 3.5 mini instruct pyomo pysim coder
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
Coding
PH
Phi 4 Mini Instruct Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
amod plnyr Phi 3.5 mini quote planName SFT v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
grounded ai phi3.5 hallucination judge merge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Barcenas 14b phi 4 v2 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
luvai phi3 i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Roleplay
PH
Phi 3 mini 4k instruct
Phi · martineden
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Moxoff Phi3Mini KTO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 logical sft i1
Phi · mradermacher
Params2.78B
Context4K
Q4_K_M1.7 GB
Reasoning
PH
yuhonghhh microsoft phi 2 fine tune alpaca chinese merged model
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 arxiv physics instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
phi2 haiku ita v0.1 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
bunnycore Phi 3.5 mini TitanFusion 0.6
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · ZeroWw
Params14B
Context128K
Smallest10.5 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · mzwing
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Partum Scribo MAGA i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing