Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 25b i1
Phi · mradermacher
Params24.9B
Context16K
Q4_K_M15.3 GB
GGUF
PH
Phi 4 Math IO i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini IFRS Accountant
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 1 5
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · rubra-ai
Params4.73B
Context128K
Q4_K_M3.0 GB
Tool use
PH
Phi 4 reasoning plus DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
Reasoning
PH
Huihui Ai.Phi 4 Abliterated
Phi · DevQuasar-9
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Ganidu Phi 3 mini 4k OLScience v02
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Microsoft Phi3 3 8B Instruct128K
Phi · CHE-72-ZLab
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · newsletter
Params14B
Context128K
Smallest11.5 GB
Coding
PH
Phi 3.5 mini instruct python coding assistant GGUF 4bit
Phi · Agnuxo
Params3.82B
Context128K
Q4_K_M2.3 GB
Coding
PH
Phi 4 Mini Instruct
Phi · worthdoing
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 super
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
phi 3 portuguese tom cat 4k instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
Phi 4 Mini Reasoning
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
orca_mini_v9_2_14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi4 Reasoning Supervisor v1
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
German RAG PHI 3.5 MINI 4B CPT HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
Phi Mini MoE
Phi · smarttasks
Params7.65B
Context4K
Q4_K_M5.0 GB
GGUF
PH
Phi 3 mini mango 1
Phi · rhysjones
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.3 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct Desyced
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 3 clinical i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
CyberRott Phi4 mini Instruct
Phi · johnknevescarrijo
Params3.84B
Context128K
Smallest7.7 GB
CodingReasoningTool use
PH
Phi 3 Mini 4k Instruct Dpo
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
microsoft Phi 3 medium 4k instruct
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing