Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
lora phi 3 demo v0
Phi · ksahoo1
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
model 8bitgguf phi3.5 financial
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · RCorvalan
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi medquad symptoms i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
HC_Phi4 Llama
Phi · dotbrt
Params14.7B
Context16K
Smallest15.6 GB
PH
DPO Kimlan Phi 4 Mini Instruct Tw
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Mini Instruct
Phi · yoursaryan
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi35 sap ax phase2
Phi · Bhuvanesh0195
Params3.82B
Context128K
Smallest2.3 GB
PH
phi2 user story
Phi · MayureshNaik
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi15 second run non quantized Q4 K M
Phi · berquetR
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 medium 4k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest8.0 GB
PH
Cream Phi 3 14B v1 Q8 0
Phi · YorkieOH10
Params14B
Context4K
Smallest14.8 GB
PH
Phi 3 medium 128k instruct Q4 K M
Phi · joshnader
Params14B
Context128K
Q4_K_M8.6 GB
PH
SauerkrautLM-Phi-3-medium
Phi · Marlon81
Params14B
Context4K
Smallest9.6 GB
PH
Phi 3.5 Mini Instruct
Phi · Thetima4
Params3.82B
Context128K
Smallest2.0 GB
PH
Phi 3 Mini 128k Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest4.1 GB
PH
companio phi3
Phi · NikIman1
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi3.5 3b
Phi · Inza124
Params3.82B
Context128K
Smallest2.4 GB
PH
Phi 3 Mini 4k Instruct Bnb 4bit Merged 16bit
Phi · allendalangin15
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
CorynInject
Phi · CorelynAI
Params3.82B
Context4K
Smallest2.3 GB
PH
phi3 jailbreak detector
Phi · NA-DAR
Params3.82B
Context4K
Smallest2.3 GB
PH
Phi 4 Reasoning Plus
Phi · IWasBorn3D
Params14.7B
Context32K
Smallest12.0 GB
PH
Phi 4 Mini Instruct
Phi · oj748
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi2 ko instruction tune Q2 K
Phi · EnverLee
Params2.86B
Context2K
Smallest1.2 GB
PH
phi 2 dpo.Q8 0
Phi · ambind
Params2.78B
Context2K
Smallest3.0 GB
PH
phi35 4k 8Sept
Phi · yongsen-teo
Params3.82B
Context128K
Smallest4.1 GB
PH
phi3.5 Q4 K M
Phi · SuchiSharma
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi4 thinking Q8 0
Phi · justinj92
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 4 Mini Instruct
Phi · AmpereComputing
Params3.84B
Context128K
Smallest3.9 GB
PH
Phi3 Market Profile
Phi · aymen-haddaji
Params3.82B
Context4K
Q4_K_M2.3 GB