Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 4 25b i1
Phi · mradermacher
Params24.9B
Context16K
Q4_K_M15.3 GB
PH
Phi 4 Math IO i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini IFRS Accountant
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 1 5
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 mini 128k instruct
Phi · rubra-ai
Params4.73B
Context128K
Q4_K_M3.0 GB
PH
Phi 4 reasoning plus DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
PH
Huihui Ai.Phi 4 Abliterated
Phi · DevQuasar-9
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Ganidu Phi 3 mini 4k OLScience v02
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Microsoft Phi3 3 8B Instruct128K
Phi · CHE-72-ZLab
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Medium 128k Instruct
Phi · newsletter
Params14B
Context128K
Smallest11.5 GB
PH
Phi 3.5 mini instruct python coding assistant GGUF 4bit
Phi · Agnuxo
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Mini Instruct
Phi · worthdoing
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 2 super
Phi · MaziyarPanahi
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 3 portuguese tom cat 4k instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
PH
Phi 4 Mini Reasoning
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
orca_mini_v9_2_14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi4 Reasoning Supervisor v1
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
German RAG PHI 3.5 MINI 4B CPT HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi Mini MoE
Phi · smarttasks
Params7.65B
Context4K
Q4_K_M5.0 GB
PH
Phi 3 mini mango 1
Phi · rhysjones
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 mini TitanFusion 0.3 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct Desyced
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 3 clinical i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
CyberRott Phi4 mini Instruct
Phi · johnknevescarrijo
Params3.84B
Context128K
Smallest7.7 GB
PH
Phi 3 Mini 4k Instruct Dpo
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
microsoft Phi 3 medium 4k instruct
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3.5 mini TitanFusion 0.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB