Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
magnifi Phi3 intent v43 3 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
CodingReasoning
PH
phi2 3random
Phi · bakkensus
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3 medium 128k instruct Q8 0
Phi · ssmits
Params14B
Context128K
Smallest14.8 GB
Coding
PH
phi3 finetuned amila009 reaxys type 1
Phi · amila009
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · alvinrach
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · space1panda
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · RCorvalan
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi medprob physiology i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · straino
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3.5 MoE Instruct
Phi · rockon1095
Params41.9B
Context128K
Smallest23.6 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · Fazmin
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · argearriojas
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · jackboyla
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Himax33
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
Phi 3 medium 128k instruct Q8 0
Phi · YorkieOH10
Params14B
Context128K
Smallest14.8 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · Aashraf995
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · duchao1210
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B MERGED Long Context QA HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 4 Q4 K M
Phi · dohque
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi3 finetuned olscience merged Q8 0
Phi · farikaw599
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · cosmeq
Params3.84B
Context128K
Smallest2.1 GB
Tool use
PH
Microsoft Phi 4 Q4 0
Phi · blogcncom
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PH
phi 2 4bit 64rank
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
phi3model 1epoch
Phi · kanakapriya
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4
Phi · raymsm
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Open R1 Distill EZOv1
Phi · grapevine-AI
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
phi4 3b ec magento
Phi · gabrielgts
Params3.84B
Context128K
Q4_K_M2.6 GB
Tool use
PH
Liskov
Phi · MandijaE
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 3.5 3099
Phi · Sahil2507
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing