Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 Deepseek R1 Distilled 16bit v2
Phi · ykarout
Params14.7B
Context16K
Q4_K_M10.2 GB
CodingReasoning
PH
Phi 2 Orange v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
AeroMind Phi4 mini
Phi · Kami574
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Audio Super
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medprob medicine i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 mini dare ties
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Empathetic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3.5 Mini Instruct
Phi · CelesteImperia
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
elliotthwang phi 2 zh
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 RP V0.2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi3 lora ktomixen post sft mathinstruct lima partial i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Bioinspired Phi 3 mini 4k
Phi · lamm-mit
Params3.82B
Context4K
Smallest2.8 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · pprp
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 4 MPOA experiment
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi 3.5 Sakura Yuzu v1.5
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
UNCENSORED Wukong Phi 3 Instruct Ablated Q4 K M
Phi · v8karlo
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 1 5
Phi · tensorblock
Params1.42B
Context2K
Smallest0.6 GB
Coding
PH
lumynax infused phi 4 text
Phi · AbteeXAILab
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Abliterated
Phi · Justbackup
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 3 medium 128k iq
Phi · neody
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Phi 3.1 mini 4k instruct
Phi · SandLogicTechnologies
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · narainp
Params3.82B
Context4K
Q4_K_M4.8 GB
Coding
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · llmware
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi4 RP o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
ihughes15234 phi35 tictactoe dpo firstonly 2epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 2 orange
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF

Keep browsing