Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest2.8 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.800000
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
microsoft phi 4 3b
Phi · cPilotGod
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 mini 128k instruct abliterated v3
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
GGUF
PH
Phi mts dialogue clinical note MEDICATIONS i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 mini 4k it french alpaca v1 Q4 K M
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M4.6 GB
Coding
PH
phi 4 Malum 230n
Phi · Chottokun
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
PH
HINDI PHI 4 B50
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
peft phi 2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3.5 mini instruct cactus fr
Phi · innermost47
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Heretic
Phi · logos-flux
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Medical QA
Phi · bouthros
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Borea Phi 3.5 mini Instruct Jp
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 imatrix
Phi · liodon-ai
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi4 Nvidia Coder Fp16
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest2.5 GB
GGUF
PH
ihughes15234 phi 3 5 mini 3k each
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 4 EngineeringJob
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi Lthy4
Phi · SicariusSicariiStuff
Params11.9B
Context16K
Smallest4.7 GB
GGUF
PH
Phi 3 mini 4k instruct Q8 0
Phi · reach-vb
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k ins June2024 Q5 K M imat
Phi · RachidAR
Params3.82B
Context4K
Smallest2.8 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · a8nova
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi medner cardiovascular pulmonary
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · firmanda
Params3.84B
Context128K
Smallest1.7 GB
Tool use
PH
neuralmagic phi 2 pruned50
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 1 i1
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi 3 mini 4k instruct
Phi · LiteLLMs
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · MaarekXL
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
avinash31d phi 2 slerp
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
rasyosef phi 2 instruct apo
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing