Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi3 Res Gguf
Phi · veeru7474
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Pruned 3B Test
Phi · saneowl
Params3B
Context128K
Q4_K_M2.3 GB
GGUF
PH
yoda phi3 mini 4k
Phi · Sahil70090
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · matteocavestri
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
MaziyarPanahi Calme 2.1 Phi3 4b
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
portfolioos ai phi3
Phi · Abhiram1317
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 128k instruct Q2 K
Phi · cminja
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi 3 mini 4k instruct Q2 K
Phi · qizc
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
Phi 3 mini 128k instruct Q8 0
Phi · kowlick
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 reasoning 4bit
Phi · shareit
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Mini 128k Instruct
Phi · aifeifei799
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · a8nova
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
dqnGPT v0.1 3.8B
Phi · DQN-Labs
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Swagtronix
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 4 Q4 K M
Phi · FullnameNameUser
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 4 Q3 K L
Phi · RCorvalan
Params14.7B
Context16K
Smallest7.9 GB
Coding
PH
phi 4 Q4 K M
Phi · ZainabZ
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 4 Q4 K M
Phi · cdeater
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi4 RP o1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
Phi 4 Heretic
Phi · pradhu007890
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi4 Ethical v2.4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi 3.5 ft
Phi · rachittshah
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Unsloth Phi 4 Mini Reasoning
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
CodingReasoningTool use
PH
amharic-phi3-mini-pretrain-cp1-gguf
Phi · simonbutt
Params3.85B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 24 10 06 Q8 0
Phi · win10
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Sakura Yuzu v1.5
Phi · win10
Params7.22B
Context4K
Smallest7.7 GB
GGUF
PH
phi3 uncensored chat Q8 0
Phi · chenly124
Params3.82B
Context4K
Smallest4.1 GB
Roleplay
PH
Phi 3 mini 4k instruct Q4 K S
Phi · fernandoruiz
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi 4 mini UNOFFICAL Q4 K M
Phi · Xiaojian9992024
Params3.75B
Context16K
Q4_K_M2.4 GB
GGUF
PH
Ukr Synth Phi 3.5gguf
Phi · karasu000
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing