Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
sqft phi 3 mini 4k 30 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi4 Model02 Endpoint
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
nvd security phi35
Phi · AnamayaVyas
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi3 Text To Sql Merged
Phi · Bhuvandesai
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 medium 4k instruct abliterated Q8 0
Phi · informatiker
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 mini 4k instruct Q5 K M
Phi · MugenYume
Params3.82B
Context4K
Smallest2.8 GB
PH
RyotaKadoya1993 phi3 translator merged3
Phi · RichardErkhov
Params14B
Context4K
Smallest5.2 GB
PH
phi lora 3b medical
Phi · falan42
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
PH
bling phi 2
Phi · llmware
Params2.78B
Context2K
Smallest1.8 GB
PH
Phi 3 mini 128k instruct Q4 K M
Phi · Salekeen
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi3-q4_k_m
Phi · HaitameLaframe
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k instruct Q8 0
Phi · joshnader
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi4 RP O1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · MugenYume
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · Morgen0052
Params3.82B
Context4K
Smallest2.2 GB
PH
QUID
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi-3-Large-5.6b
Phi · Cali9994
Params5.63B
Context4K
Q4_K_M3.4 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · cminja
Params3.82B
Context128K
Smallest4.1 GB
PH
phi3-mini-4k-gguf
Phi · MohamedSaeed-dev
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3 mini 4k instruct Q3 K S
Phi · yh-yao
Params3.82B
Context4K
Smallest1.7 GB
PH
Phi4 Nvidia Coder
Phi · ykarout
Params14.7B
Context16K
Smallest12.0 GB
PH
phi 1 5 Q4 K M
Phi · Merhabalad
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
phi 4 Q8 0
Phi · ProbioticFarmer
Params14.7B
Context16K
Smallest15.6 GB
PH
htech compliance
Phi · cpiuk
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
PH
Phi 4 Mini Instruct
Phi · chaparro2001
Params3.84B
Context128K
Smallest1.7 GB
PH
Phi 3 Medium 128k Instruct
Phi · tayhym
Params14B
Context128K
Q4_K_M8.6 GB
PH
phi3 islamqa
Phi · hanzala-dr
Params3.82B
Context4K
Q4_K_M2.3 GB