Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 Q5 K M
Phi · pipilok
Params14.7B
Context16K
Smallest10.6 GB
GGUF
PH
Phi4 trained with func explain ep1
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
phi 2 Q5 K M
Phi · straino
Params2.78B
Context2K
Smallest2.0 GB
Coding
PH
Phi 3 medium 4k instruct Q4 K M
Phi · mudler
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi_4_14b_finetuned_graph_3_epoch_gguf
Phi · KS112
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
kuro phi3.5
Phi · iMiranda
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3 4k it nvidia chat q4
Phi · saurabhapd
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
phi tune 15oct
Phi · Kapil003
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi4 finetune finetome 20260211 100630 best evalloss step00650 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 4 Q5 K S
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest10.2 GB
Coding
PH
Phi 3.5 mini TitanFusion 0.4.1 Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Medium 4k Instruct Biomarker
Phi · farikaw599
Params66M
Context—
Smallest0.3 GB
GGUF
PH
phi 4 mini LoRA adapter 3MPER0RR abliterated Q8 0
Phi · 3MPER0RR
Params2M
Context—
Smallest0.0 GB
GGUF
PH
Phi4 Legal Layman 16K
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi SoSerious Mini V1
Phi · concedo
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Susnato Phi 2
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest9.6 GB
Coding
PH
Phi medprob biochemistry i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
dre_phi_3_dre_gguf
Phi · empgces
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
wrcfinetuned
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3 mini 4k instruct q4
Phi · Ankitajadhav
Params3.82B
Context4K
Smallest2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · saneowl
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3.5 MoE Instruct
Phi · noctrex
Params41.9B
Context128K
Smallest23.1 GB
GGUF
PH
phi4 mini intent
Phi · cngchis
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 2 orange v2
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 0
Phi · yh-yao
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · ckirby
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
tryModel_12
Phi · mrkswe
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 reasoning plus gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
llava phi3 mini
Phi · l3utterfly
Params3.82B
Context4K
Smallest2.3 GB
Vision

Keep browsing