Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
parsak phi 2 code instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi 4 Mini Instruct Heretic v1.2
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
IntelLabs sqft phi 3 mini 4k 40 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Empathetic i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Mini 4k Grammar Correction
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi Lthy4
Phi · duyntnet
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
microsoft.Phi 4 Mini Reasoning
Phi · DevQuasar
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Bioinspired Phi 3 Mini 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
grounded ai phi3 toxicity judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 2 meditron
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
DZ TDPO Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct Obliterated Zero
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Borea Phi 3.5 Mini Instruct Common
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 1960 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4Garu telugu 14b i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · professorf
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 4 MPOA experiment i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3.5 mini instruct python coding assistant GGUF 16bit
Phi · Agnuxo
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
grounded ai phi3 rag relevance judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Super o1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
microsoft.phi 4
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 2 Electrical Engineering
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi3 ITA mini 4K instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi3 medical del ltr i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
Phi 4 ColdBrew 14B Intrepid
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi 2
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing