Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Amod Phi 3.5 mini quote planName SFT PLNYR
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
absl2024 Phi3 Mini 4k CustomtryTry1
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 1.5B S Soft Distill
Phi · mradermacher
Params1.5B
Context4K
Q4_K_M1.0 GB
GGUF
PH
Phi 4 Reasoning Vision 15B ROCmFP4
Phi · kingjones777
Params14.7B
Context32K
Smallest8.5 GB
ReasoningVision
PH
jcorte real phi35 pd kb lora model v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
phi4_15_epoch_PHP
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Cinder Phi 2 STEM 2.94B Test
Phi · Josephgflowers
Params2.94B
Context2K
Smallest5.9 GB
Coding
PH
phi 4
Phi · recursechat
Params14.7B
Context16K
Smallest3.6 GB
Coding
PH
Phi 2 Layla v1 Chatml
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
luvai phi3
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Roleplay
PH
Phi4 MedIT 10B O1
Phi · mradermacher
Params10.3B
Context16K
Q4_K_M6.2 GB
Coding
PH
phi 4 25b
Phi · mradermacher
Params24.9B
Context16K
Q4_K_M15.3 GB
GGUF
PH
Phi 3 mini 128K Instruct
Phi · pjh64
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
sqft phi 3 mini 4k 50 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
boo
Phi · leeroy-jankins
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
katuni4ka tiny random phi3
Phi · RichardErkhov
Params—
Context4K
Q4_K_M0.0 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-1
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
phi3.5 mini exp 825 uncensored
Phi · MaziyarPanahi
Params3.82B
Context128K
Smallest2.6 GB
GGUF
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 60 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Moxoff Phi3Mini DPO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Context Obedient RAG
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4Garu telugu 14b
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini 6b Merge
Phi · mradermacher
Params6.25B
Context128K
Q4_K_M4.0 GB
Tool use
PH
Phi 4 Reasoning plus_Nemotron Reasoning 0803_SFT GRPO
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3.5 Mini Instruct
Phi · cortexso
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 instruct v0.1
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
GGUF
PH
DeepThink Phi4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · MaziyarPanahi
Params14B
Context4K
Smallest9.6 GB
GGUF

Keep browsing