Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 2 OmniMatrix i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PH
phi 2 electrical engineering
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi-4-mini-instruct
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Tess v2.5 Phi 3 medium 128k 14B i1
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
PH
phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi3.5 gutenberg 4B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3 mini 128k instruct imatrix
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 4 Reasoning plus_Nemotron Reasoning 0803_SFT GRPO
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · second-state
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
calme 2.2 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 mini 128k instruct
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini ChatML
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB