Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
lora phi 3 demo v0
Phi · ksahoo1
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
model 8bitgguf phi3.5 financial
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RCorvalan
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi medquad symptoms i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
HC_Phi4 Llama
Phi · dotbrt
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
DPO Kimlan Phi 4 Mini Instruct Tw
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · yoursaryan
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi35 sap ax phase2
Phi · Bhuvanesh0195
Params3.82B
Context128K
Smallest2.3 GB
GGUF
PH
phi2 user story
Phi · MayureshNaik
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi15 second run non quantized Q4 K M
Phi · berquetR
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context4K
Smallest8.0 GB
Coding
PH
Cream Phi 3 14B v1 Q8 0
Phi · YorkieOH10
Params14B
Context4K
Smallest14.8 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K M
Phi · joshnader
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
SauerkrautLM-Phi-3-medium
Phi · Marlon81
Params14B
Context4K
Smallest9.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Thetima4
Params3.82B
Context128K
Smallest2.0 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
companio phi3
Phi · NikIman1
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi3.5 3b
Phi · Inza124
Params3.82B
Context128K
Smallest2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct Bnb 4bit Merged 16bit
Phi · allendalangin15
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
CorynInject
Phi · CorelynAI
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
phi3 jailbreak detector
Phi · NA-DAR
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · IWasBorn3D
Params14.7B
Context32K
Smallest12.0 GB
CodingReasoning
PH
Phi 4 Mini Instruct
Phi · oj748
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi2 ko instruction tune Q2 K
Phi · EnverLee
Params2.86B
Context2K
Smallest1.2 GB
GGUF
PH
phi 2 dpo.Q8 0
Phi · ambind
Params2.78B
Context2K
Smallest3.0 GB
GGUF
PH
phi35 4k 8Sept
Phi · yongsen-teo
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
phi3.5 Q4 K M
Phi · SuchiSharma
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi4 thinking Q8 0
Phi · justinj92
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 4 Mini Instruct
Phi · AmpereComputing
Params3.84B
Context128K
Smallest3.9 GB
Tool use
PH
Phi3 Market Profile
Phi · aymen-haddaji
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing