Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
microsoft phi 4 GGUF Q4 K S
Phi · sigmanih
Params14.7B
Context16K
Smallest8.5 GB
PH
orpo phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 2 orange v2 GGUF IQ Imatrix
Phi · ABX-AI
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Gpt Oss 120b Distill Phi 4 14B
Phi · Dzluck
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PH
phi 2 medical chat v0 model i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
EZO Phi 4 V2_900
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 mini 4k instruct Cinder with 16bit
Phi · Josephgflowers
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 1_5 Finetuned Gsm8K
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Borea Phi 3.5 Mini Instruct Common
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Sayan01/Phi35-1B-OWM-20
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
phi 3 mini 128k f16
Phi · professorf
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi 4 Stock Ex
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 1 5
Phi · DhruvalLabs
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · stratalab-org
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct Heretic v1.2
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
trl internal testing tiny Phi3ForCausalLM
Phi · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
PH
openvoid Prox Phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · LoneStriker
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
dankalin phi3 medium instruct
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
PH
Cinder Phi 2 V1 F16
Phi · Josephgflowers
Params2.78B
Context2K
Smallest5.6 GB
PH
phi2 haiku ita v0.1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 3 medium 4k 14b instruct
Phi · lm-kit
Params14B
Context4K
Q4_K_M8.6 GB
PH
rasyosef phi 2 instruct v0.1
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Inferless inferless phi 2 DPO
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
edumunozsala phi3 mini python code 20k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB