Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Stoma i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
GGUF
PH
Phi 3.5 mini instruct Jopara V3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
LoRAfrica
Phi · DannyAI
Params2M
Context128K
Q4_K_M2.5 GB
GGUF
PH
ehartford phi3 4k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
sujithatz finbot transofrmer based phi3.5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4.Turn.R1Distill v1.5.1 Tensors
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3.5 mini TitanFusion V2
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3-4k-sentiment-may-24-2024-2epoches
Phi · seandearnaley
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · tensorblock
Params41.9B
Context128K
Smallest15.3 GB
Coding
PH
phi 3 mini uncensored
Phi · arzaan789
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Joycean0301 Phi 2 2.7B Instruct Medical Conversational
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 2 aligned
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ab ai PII Model Phi3 Mini
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
omost phi 3 mini 128k i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Trim i1
Phi · mradermacher
Params6.14B
Context16K
Q4_K_M3.8 GB
GGUF
PH
Euclid Phi2 Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct Function Calling
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
Tool use
PH
Heliars Phi4 Carla X1 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Reasoning
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
phi2 haiku ita v0.2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 quantized
Phi · radames
Params2.78B
Context—
Smallest1.6 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Genuine Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 1.5 Tele
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 4 Mini Instruct Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use

Keep browsing