Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 3 8bit Q8 0
Phi · LeonardLangsdorf
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi2 CoT
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 4 reasoning vision q4 k s
Phi · Manojb
Params14.7B
Context32K
Smallest8.4 GB
PH
Phi 3 mini 4k instruct
Phi · Sparsh8123
Params3.82B
Context4K
Smallest2.4 GB
PH
Phi4 Codex
Phi · owenqwenllmwine
Params3.84B
Context128K
Smallest3.2 GB
PH
scm_phi3_q8
Phi · sebdg
Params3.82B
Context4K
Smallest4.1 GB
PH
omega coder phi 3 mini 1K
Phi · samuelswandi
Params3.82B
Context4K
Smallest15.3 GB
PH
Phi 3 medium 128k instruct Q6 K
Phi · teemperor
Params14B
Context128K
Smallest11.5 GB
PH
Phi 3 Mini 4k Instruct
Phi · nulledinstance
Params3.82B
Context4K
Smallest3.1 GB
PH
Vitas Ayurveda Phi3
Phi · Chaitu6969
Params3.82B
Context4K
Smallest2.3 GB
PH
phi 3 mini 4k instruct
Phi · elysiantech
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · janspoerer
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi medner consult historyandphy i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
magnifi Phi3 intent v43 1 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
PH
phi 2223
Phi · stevendhasoi
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 3.5 mini finetuned
Phi · shlok56
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3-mini-gguf
Phi · ALI-B
Params3.82B
Context4K
Smallest7.6 GB
PH
phi 3.1 abliterated Q5 K M
Phi · MugenYume
Params3.82B
Context4K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct
Phi · vonjack
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning Plus
Phi · ldostadi
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3.5 16bit
Phi · Swissmountain
Params3.82B
Context128K
Smallest7.6 GB
PH
phi 4 reasoning vision q4 K M
Phi · Manojb
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
telehealth phi2
Phi · simmihugs
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
scm_phi3_q5_k_m_v3
Phi · sebdg
Params3.82B
Context4K
Smallest2.7 GB
PH
phi 3 ProductRecommendations
Phi · srikar-v05
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · sheldonrobinson
Params3.82B
Context128K
Q4_K_M2.4 GB