Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
ihughes15234 phi 3 5 mini 20k con4 bthrough parmdiff
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Calme 2.1 Phi3 4b
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 4 unslothed lora
Phi · sugatoray
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Microsoft Phi 4 Mini Reasoning
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
CodingReasoningTool use
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 2 Layla v1 Chatml
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 matt medicine
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Ektome Phi 3.5 mini i PristinelyUncensored
Phi · Zynerji
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi2 sqlcoder
Phi · pavankumarbalijepalli
Params2.78B
Context2K
Smallest5.6 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · liodon-ai
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 instruct CBR Bonds info
Phi · winterForestStump
Params3.82B
Context128K
Q4_K_M2.3 GB
Embedding
PH
Phi4_Sql_Finetuned
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
gguf Q5 K M Phi 1 5 Instruct v0.1
Phi · Felladrin
Params1.41B
Context2K
Smallest1.0 GB
Tool use
PH
phi 2 instruct
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
ankit011 phi 2 code
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
phi 2 DLEC i1
Phi · mradermacher
Params3.25B
Context2K
Q4_K_M2.0 GB
GGUF
PH
Phi4.Turn.R1Distill.16bit i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.6
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Reasoning Heretic
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi4 Toxic Lora Merged
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi 2
Phi · nold
Params2.78B
Context2K
Smallest1.9 GB
Coding
PH
Phi 3 mini 4k instruct June2024 Q6 K
Phi · RachidAR
Params3.82B
Context4K
Smallest3.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · redhat6
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 4 deepseek r1 distilled latest
Phi · ykarout
Params14.7B
Context16K
Q4_K_M9.7 GB
CodingReasoning
PH
Phi 4 Mini Reasoning Abliterated
Phi · dev-196
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
microsoft phi 2 pytdml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 mini 128k italian v2 Q4 K M chunked
Phi · BoscoTheDog
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
microsoft Phi 3.5 mini instruct fine tuned by yahma alpaca cleaned
Phi · hali52441
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Sakura Yuzu v1.5
Phi · mradermacher
Params7.22B
Context4K
Q4_K_M4.5 GB
GGUF

Keep browsing