Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi Stoma i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
PH
Phi 3.5 mini instruct Jopara V3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
LoRAfrica
Phi · DannyAI
Params2M
Context128K
Q4_K_M2.5 GB
PH
ehartford phi3 4k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
sujithatz finbot transofrmer based phi3.5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi4.Turn.R1Distill v1.5.1 Tensors
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 mini TitanFusion V2
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3-4k-sentiment-may-24-2024-2epoches
Phi · seandearnaley
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 MoE Instruct
Phi · tensorblock
Params41.9B
Context128K
Smallest15.3 GB
PH
phi 3 mini uncensored
Phi · arzaan789
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Joycean0301 Phi 2 2.7B Instruct Medical Conversational
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 2 aligned
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
calme-2.1-phi3.5-4b
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ab ai PII Model Phi3 Mini
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
omost phi 3 mini 128k i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Trim i1
Phi · mradermacher
Params6.14B
Context16K
Q4_K_M3.8 GB
PH
Euclid Phi2 Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 4k Instruct Function Calling
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Heliars Phi4 Carla X1 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
phi2 haiku ita v0.2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 2 quantized
Phi · radames
Params2.78B
Context—
Smallest1.6 GB
PH
Phi 4 Mini Reasoning
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Genuine Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 1.5 Tele
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 4 Mini Instruct Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB