Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi arxiv math instruct i1
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · meetara-spark
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi-3-mini-4k-instruct
Phi · AlekseyElygin
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · xaskasdf
Params3.82B
Context128K
Smallest1.5 GB
GGUF
PH
phi 4 mini adr detector
Phi · sumitguha13
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3 medium 128k instruct
Phi · LiteLLMs
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · confusion8760
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
MaziyarPanahi calme 2.3 phi3 4b
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 4 Q4 K M
Phi · reach-vb
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 2 medical chat v0 model
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 imatrix
Phi · ristew
Params2.78B
Context2K
Smallest0.7 GB
GGUF
PH
phi 3 mini 128k f16
Phi · professorf
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
Phi 4 harupfall
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Tool use
PH
Phi 3.5 Mini instruct_Uncensored
Phi · zsolx2
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi3 lora 1000 dc unswnb15
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
saiga phi3 medium sft m1 d2 kto m5 d7
Phi · olkovi
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
phi 2 super
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
phi 3 orpo v8 16
Phi · cstr
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
phi 4
Phi · GPT4All-Community
Params14.7B
Context16K
Smallest8.4 GB
Coding
PH
Liquid-SQL-1
Phi · Liquid1
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 2 insurance qa sft lora gguf f16
Phi · deccan-ai
Params2.78B
Context2K
Smallest5.6 GB
Coding
PH
Phi 3.5 mini instruct 24 9 29
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2
Phi · mparvin
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · ldostadi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 4 Mini Instruct
Phi · ysn-rfd
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
GREEN Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Finetuned Phi3.5
Phi · LioneWang
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi Mini 3.5 R1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
win10 phi3.5 pro 10 08
Phi · RichardErkhov
Params4.95B
Context128K
Q4_K_M3.1 GB
GGUF
PH
phi4 14b nerc cip
Phi · awb25
Params14.7B
Context16K
Smallest29.3 GB
GGUF

Keep browsing