Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi3-lobbying-gguf
Phi · twright8
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 4 Mini Instruct
Phi · arifsw
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
magnifi Phi3 intent v44 1 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi-3-mini-4k-instruct_q5_k_m_gguf
Phi · datnguyen-dbs
Params3.82B
Context4K
Smallest2.7 GB
PH
Phi 4 Reasoning
Phi · mmnga
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ExpertiaSWE Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
juanid-phi3-instruct-finetuned-GGUF
Phi · junaidiqbalsyed
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Smallest4.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · Lucy-in-the-Sky
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Instruct
Phi · bchen-snp
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 4 Q8 0
Phi · paramedik
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi4 func explain
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 3 mini 4k instruct Q4 K S
Phi · mrmage
Params3.82B
Context4K
Smallest2.2 GB
PH
phi_3_math_fine_tuned_gguf
Phi · Ebullioscopic
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi3mini conversational drone
Phi · manhvuvan
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · matheusUema
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
scm_phi3_q4_k_m
Phi · sebdg
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 3.5 sakura yuzu v2.5 Q8 0
Phi · win10
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Oneshot
Phi · dianak12
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
meha_html_model_q4_k_m-GGUF
Phi · jawerty
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 mini ITA Q8 0
Phi · lukecage
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · argearriojas
Params3.82B
Context128K
Smallest2.2 GB
PH
MoxoffSrL Moxoff Phi3Mini PPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3 medium 128k instruct Q6 K
Phi · ssmits
Params14B
Context128K
Smallest11.5 GB
PH
Phi 3 medium 128k instruct Q4 K M
Phi · AdvaitTahilyani
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3.5 Mini Instruct
Phi · roleplaiapp
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi medprob anatomy
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Instruct
Phi · kolosal
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi4 inno handbook2
Phi · aaronnat23
Params14.7B
Context16K
Smallest15.6 GB