Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 1 5 Q3 K M
Phi · Merhabalad
Params1.42B
Context2K
Smallest0.7 GB
Coding
PH
phi 3 mini 128k function calling
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Tool use
PH
Phi medner cardiovascular pulmonary i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Text2Sql Sagemaker
Phi · vvnaren
Params9M
Context—
Smallest0.0 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · Kondara
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
ht6 phi3mini.1efinetune
Phi · sjsaug17
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · yxzhong
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi3 mini Docuanalyzer
Phi · VGreatVig07
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Tien-THM
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3 medium 128k instruct Q5 K M
Phi · ssmits
Params14B
Context128K
Smallest10.1 GB
Coding
PH
Phi-3-medium-4k-instruct
Phi · weiiv
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
aigf-phi3-mini-v6
Phi · pranav79
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q8 0
Phi · gsayak
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Sayan01 Phi2 by3 Layer
Phi · RichardErkhov
Params905M
Context2K
Q4_K_M0.7 GB
GGUF
PH
Phi 4 Health CoT 1.1 Q4 K M
Phi · Yujivus
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi4-Conversational
Phi · Ashishdalmia
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
ihughes15234 phi 3 mini 500 combined 6 1 epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 1 5 Q4 K M
Phi · darrenrourkeuk
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · rockon1095
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
phi 3.5 moe q2 k cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Smallest15.3 GB
GGUF
PH
teddy 3.5b
Phi · Infiniaai
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · StageMind
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 mini LE narrative
Phi · jtiner
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
portuguese Phi3 Tom Cat 128k instruct IQ4 NL
Phi · fernandovmacedo
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Adoresever
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi medmcqa question generation medicine lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Reasoning
Phi · lokinfey
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi3.5_Sharegpt_Finetuned
Phi · ericilavia
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
MinaMila phi3 unlearnedunlearned 2nd 1.0 0.5 0.25 0.15 epoch1
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF

Keep browsing