Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · shahzeb171
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
phi 2 imatrix
Phi · liodon-ai
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phinance Phi 4 mini instruct finance v0.4 with reasoning
Phi · Josephgflowers
Params3.84B
Context128K
Q4_K_M2.5 GB
Reasoning
PH
Liquid-MDG-1
Phi · Liquid1
Params8.03B
Context4K
Q4_K_M2.3 GB
GGUF
PH
orion penner phi 2 test
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Hmehdi515 fine tuned phi3 combined2
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Nixon
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
HugoVoxx phi 3.5 mini it ag merged model
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Orange v2
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
DeepThink Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi4 Slerp 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Euclid Phi2 Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
racist phi3
Phi · DuckyBlender
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Barcenas 14b phi 4 v2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
ivilson phi 3 mini 128k function calling
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
Tool use
PH
Phi 3 Mini 4k Instruct
Phi · Sr16solid
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ashmitkx phi 2 aligned
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 bitnet 1.58b
Phi · tzervas
Params14.7B
Context16K
Smallest5.6 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · GainPublications
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · ginesew43
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
FFT Microsoft Phi 4 Mini Instruct
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 14B Instruct sft
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Test_Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Multi Ability Chatbot
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
HugoVoxx phi 3 mini 4k it ag merged model
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi3 StoryGenerator
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · ukung
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing