Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 4 GGUF imatrix
Phi · mcm07
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 R1 Medical3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · fernandoruiz
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi4 Codestandard
Phi · zakie0161
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 4k Instruct
Phi · Edge-Quant
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi medprob pathology i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 mini 128k instruct GPT4Choice 4.6k DPO IQ4 NL
Phi · cleatherbury
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 4 14b It R1 M22K_Lora
Phi · c00cjz00
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Mini Instruct
Phi · BernTheCreator
Params3.84B
Context128K
Smallest2.3 GB
PH
Kanoonu AI Phi3
Phi · tejasgowda05
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi3Unlocked
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
PH
repo
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3 Medium 128k Instruct
Phi · itlwas
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi35 3B 1B CLM
Phi · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
Phi 3.5 Mini Instruct
Phi · meetara-lab
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 medium 128k instruct Q4 K M
Phi · ssmits
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3 mini 128k instruct Q4 K M
Phi · springwater
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · sdrshn-nmbr
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · freakyXO
Params3.82B
Context4K
Smallest2.2 GB
PH
Phi 3.5 Mini Instruct
Phi · flyfishstudio
Params3.82B
Context128K
Smallest2.2 GB
PH
phi3 avro gguf q4km
Phi · oriolrius
Params3.82B
Context4K
Smallest7.6 GB
PH
phi35 sap ax instruct
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi4 actualplay
Phi · elaverick
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
contactextraction_zsj_phi3-bnb-4bit_finetuned_0.0.3
Phi · ashokpoudel
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 4 Q4 K M
Phi · dean2155
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 4 Q4 0
Phi · msyukorai
Params14.7B
Context16K
Smallest8.3 GB
PH
phi 4 Q3 K S
Phi · RCorvalan
Params14.7B
Context16K
Smallest6.5 GB
PH
Phi3 Legal Finetuned
Phi · sairamn
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 3.5 moe q8 0 cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Smallest44.5 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · Testasfsd
Params3.82B
Context128K
Smallest4.1 GB