Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
hackint0sh phi 3 clinical
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · xaskasdf
Params3.82B
Context4K
Smallest1.2 GB
GGUF
PH
phi4 noesis i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
objects76 Phi 3.5 mini instruct fc
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Instruct Eco Bioaligned
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
Karun 7 phi3 mini 128k it ds
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 DASHQ Q2
Phi · jkim96
Params14.7B
Context16K
Smallest4.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · brittlewis12
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 ReasoningRP
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 4 Mini Reasoning Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · ALexJM19
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi medmcqa question generation pediatrics lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5_tw
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Stoicism1 Phi3.5 mini instruct i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · anurag4884
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Moxoff Phi3Mini PPO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-20
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
RYS Phi 3 Medium 4k Instruct
Phi · mradermacher
Params17.7B
Context4K
Q4_K_M10.8 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · ManthanLabs
Params3.84B
Context128K
Smallest2.3 GB
Tool use
PH
TeleQnA Phi2 Phinetune
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 mini maths i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct iMat
Phi · qwp4w3hyb
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Einstein v4 phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
CodingTool use
PH
Phi 3 Mini 4k Instruct
Phi · DhruvalLabs
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
sqft sparsepeft phi 3 mini 4k 40 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi4.Turn.R1Distill v1.5.1 Q4 k
Phi · Quazim0t0
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
grounded ai.phi3.5 rag relevance judge merge
Phi · DevQuasar-3
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding

Keep browsing