Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 1 5 Q3 K M
Phi · Merhabalad
Params1.42B
Context2K
Smallest0.7 GB
PH
phi 3 mini 128k function calling
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi medner cardiovascular pulmonary i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Text2Sql Sagemaker
Phi · vvnaren
Params9M
Context—
Smallest0.0 GB
PH
Phi 3 Medium 4k Instruct
Phi · Kondara
Params14B
Context4K
Q4_K_M8.6 GB
PH
ht6 phi3mini.1efinetune
Phi · sjsaug17
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · yxzhong
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3 mini Docuanalyzer
Phi · VGreatVig07
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 4 Mini Instruct
Phi · Tien-THM
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 medium 128k instruct Q5 K M
Phi · ssmits
Params14B
Context128K
Smallest10.1 GB
PH
Phi-3-medium-4k-instruct
Phi · weiiv
Params14B
Context4K
Q4_K_M8.4 GB
PH
aigf-phi3-mini-v6
Phi · pranav79
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k instruct Q8 0
Phi · gsayak
Params3.82B
Context4K
Smallest4.1 GB
PH
Sayan01 Phi2 by3 Layer
Phi · RichardErkhov
Params905M
Context2K
Q4_K_M0.7 GB
PH
Phi 4 Health CoT 1.1 Q4 K M
Phi · Yujivus
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi4-Conversational
Phi · Ashishdalmia
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
ihughes15234 phi 3 mini 500 combined 6 1 epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 1 5 Q4 K M
Phi · darrenrourkeuk
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3.5 Mini Instruct
Phi · rockon1095
Params3.82B
Context128K
Smallest2.2 GB
PH
phi 3.5 moe q2 k cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Smallest15.3 GB
PH
teddy 3.5b
Phi · Infiniaai
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · StageMind
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 mini LE narrative
Phi · jtiner
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
portuguese Phi3 Tom Cat 128k instruct IQ4 NL
Phi · fernandovmacedo
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3.5 Mini Instruct
Phi · Adoresever
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi medmcqa question generation medicine lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Reasoning
Phi · lokinfey
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi3.5_Sharegpt_Finetuned
Phi · ericilavia
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
MinaMila phi3 unlearnedunlearned 2nd 1.0 0.5 0.25 0.15 epoch1
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB