Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
sqft phi 3 mini 4k 30 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi4 Model02 Endpoint
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
nvd security phi35
Phi · AnamayaVyas
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi3 Text To Sql Merged
Phi · Bhuvandesai
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct abliterated Q8 0
Phi · informatiker
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 mini 4k instruct Q5 K M
Phi · MugenYume
Params3.82B
Context4K
Smallest2.8 GB
Coding
PH
RyotaKadoya1993 phi3 translator merged3
Phi · RichardErkhov
Params14B
Context4K
Smallest5.2 GB
GGUF
PH
phi lora 3b medical
Phi · falan42
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
CodingReasoning
PH
bling phi 2
Phi · llmware
Params2.78B
Context2K
Smallest1.8 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K M
Phi · Salekeen
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi3-q4_k_m
Phi · HaitameLaframe
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q8 0
Phi · joshnader
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi4 RP O1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
Phi 3 mini 4k instruct Q4 K M
Phi · MugenYume
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · Morgen0052
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
QUID
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi-3-Large-5.6b
Phi · Cali9994
Params5.63B
Context4K
Q4_K_M3.4 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · cminja
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
phi3-mini-4k-gguf
Phi · MohamedSaeed-dev
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 4k instruct Q3 K S
Phi · yh-yao
Params3.82B
Context4K
Smallest1.7 GB
Coding
PH
Phi4 Nvidia Coder
Phi · ykarout
Params14.7B
Context16K
Smallest12.0 GB
Coding
PH
phi 1 5 Q4 K M
Phi · Merhabalad
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
phi 4 Q8 0
Phi · ProbioticFarmer
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
htech compliance
Phi · cpiuk
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · chaparro2001
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
Phi 3 Medium 128k Instruct
Phi · tayhym
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
phi3 islamqa
Phi · hanzala-dr
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing