Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
parsak phi 2 code instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Instruct Heretic v1.2
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
IntelLabs sqft phi 3 mini 4k 40 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Empathetic i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 4k Grammar Correction
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi Lthy4
Phi · duyntnet
Params11.9B
Context16K
Q4_K_M7.3 GB
PH
microsoft.Phi 4 Mini Reasoning
Phi · DevQuasar
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Bioinspired Phi 3 Mini 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
grounded ai phi3 toxicity judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 2 meditron
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
DZ TDPO Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct Obliterated Zero
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Borea Phi 3.5 Mini Instruct Common
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 1960 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4Garu telugu 14b i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Mini Instruct
Phi · professorf
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 4 MPOA experiment i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3.5 mini instruct python coding assistant GGUF 16bit
Phi · Agnuxo
Params3.82B
Context128K
Smallest7.6 GB
PH
grounded ai phi3 rag relevance judge merge
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Super o1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
microsoft.phi 4
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 2 Electrical Engineering
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi3 ITA mini 4K instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi3 medical del ltr i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 ColdBrew 14B Intrepid
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi 2
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB