Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
microsoft phi 4 GGUF Q4 K S
Phi · sigmanih
Params14.7B
Context16K
Smallest8.5 GB
GGUF
PH
orpo phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 orange v2 GGUF IQ Imatrix
Phi · ABX-AI
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Gpt Oss 120b Distill Phi 4 14B
Phi · Dzluck
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
phi 2 medical chat v0 model i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
EZO Phi 4 V2_900
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 mini 4k instruct Cinder with 16bit
Phi · Josephgflowers
Params3.82B
Context4K
Smallest7.6 GB
Coding
PH
Phi 1_5 Finetuned Gsm8K
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Common
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Line_14B
Phi · bartowski
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Sayan01/Phi35-1B-OWM-20
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
phi 3 mini 128k f16
Phi · professorf
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
Phi 4 Stock Ex
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 1 5
Phi · DhruvalLabs
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
EduRABSA_SLM_v1_SLERP_phi4mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · stratalab-org
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct Heretic v1.2
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
trl internal testing tiny Phi3ForCausalLM
Phi · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
PH
openvoid Prox Phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · LoneStriker
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
dankalin phi3 medium instruct
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Cinder Phi 2 V1 F16
Phi · Josephgflowers
Params2.78B
Context2K
Smallest5.6 GB
Coding
PH
phi2 haiku ita v0.1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 medium 4k 14b instruct
Phi · lm-kit
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
rasyosef phi 2 instruct v0.1
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Inferless inferless phi 2 DPO
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
edumunozsala phi3 mini python code 20k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding

Keep browsing