Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Borea Phi 3.5 Mini Instruct Common
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · SixOpen
Params3.82B
Context4K
Q4_K_M4.8 GB
Coding
PH
Moxoff Phi3Mini ORPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Luminis phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 128k instruct function
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · gaianet
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 4 Mini Instruct
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
TaliML PHI3 128K ITA V.1.0.FINAL i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Ph3task2 14B
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
microsoft phi 1 5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · second-state
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
phi 3 mini 4k instruct.Q4 0
Phi · Jaward
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 2
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
Phi 4 Mini Reasoning Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 4 Reasoning Plus
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Orca_Mini_Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
microsoft.Phi 4 Reasoning Plus
Phi · DevQuasar
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3 Mini 4k Instruct
Phi · gaianet
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Bioinspired Phi 3 mini 4k
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct old
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini investigator_16B
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 2 code instruct
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
phi 2 sft alpaca gpt4 en ep1
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Neos Phi 3 14B v0.1 i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
microsoft Phi 3 medium 128k instruct
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Agnuxo Phi 3.5 Trinitron Instruct CODE Python English Asistant 16bit v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
Coding
PH
Phi 3 Context Obedient RAG
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing