Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 4 Q5 K M
Phi · pipilok
Params14.7B
Context16K
Smallest10.6 GB
PH
Phi4 trained with func explain ep1
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
PH
phi 2 Q5 K M
Phi · straino
Params2.78B
Context2K
Smallest2.0 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · mudler
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi_4_14b_finetuned_graph_3_epoch_gguf
Phi · KS112
Params14.7B
Context16K
Smallest10.4 GB
PH
kuro phi3.5
Phi · iMiranda
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3 4k it nvidia chat q4
Phi · saurabhapd
Params3.82B
Context4K
Smallest2.4 GB
PH
phi tune 15oct
Phi · Kapil003
Params3.82B
Context4K
Smallest7.6 GB
PH
phi4 finetune finetome 20260211 100630 best evalloss step00650 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 4 Q5 K S
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
PH
Phi 3.5 mini TitanFusion 0.4.1 Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Medium 4k Instruct Biomarker
Phi · farikaw599
Params66M
Context—
Smallest0.3 GB
PH
phi 4 mini LoRA adapter 3MPER0RR abliterated Q8 0
Phi · 3MPER0RR
Params2M
Context—
Smallest0.0 GB
PH
Phi4 Legal Layman 16K
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi SoSerious Mini V1
Phi · concedo
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Susnato Phi 2
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest9.6 GB
PH
Phi medprob biochemistry i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
dre_phi_3_dre_gguf
Phi · empgces
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
wrcfinetuned
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 3 mini 4k instruct q4
Phi · Ankitajadhav
Params3.82B
Context4K
Smallest2.4 GB
PH
Phi 4 Mini Instruct
Phi · saneowl
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 MoE Instruct
Phi · noctrex
Params41.9B
Context128K
Smallest23.1 GB
PH
phi4 mini intent
Phi · cngchis
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 2 orange v2
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
PH
Phi 3 mini 4k instruct Q4 0
Phi · yh-yao
Params3.82B
Context4K
Smallest2.2 GB
PH
Phi 3.5 Mini Instruct
Phi · ckirby
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
tryModel_12
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 reasoning plus gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
llava phi3 mini
Phi · l3utterfly
Params3.82B
Context4K
Smallest2.3 GB