Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 mini 128k instruct Q8 0
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 2 Finetuned Qa Medmcqa
Phi · farikaw599
Params26M
Context—
Smallest0.1 GB
PH
Einstein v6.1 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 mini 128k instruct Q4 K M
Phi · ElMater06
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
L3Utterfly Phi 2 Layla v1
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
PH
model 1125 8bit
Phi · bau0221
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Base 1102
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi therapist chat v1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
bhanudaybirla phi3 dapt3
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
ggml phi 4 reasoning vision 15b q4 k
Phi · Manojb
Params14.7B
Context32K
Smallest9.7 GB
PH
phi 3 tiny random
Phi · tensorblock
Params1M
Context128K
Smallest0.0 GB
PH
Phi 4 Reasoning
Phi · ghostoverflow
Params14.7B
Context32K
Smallest15.6 GB
PH
phi 2 Q4 K M
Phi · codegood
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
dfda
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
joke finetome model gguf phi4 20260106 065852
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi-3-mini_GGUF-GameStory
Phi · frikh-said
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 medium 128k instruct Q4 K M
Phi · Sc0m3r
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3 medium 4k instruct abliterated Q4 K M
Phi · informatiker
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
L3Utterfly Phi 2 Layla v1 Chatml
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
PH
SL constitutional law qa phi 4
Phi · Shifaur
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Mini Instruct
Phi · jagan546
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi4 grpo gguf q8
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · yh-yao
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi SoSerious Mini V1 Q8 0 Q6 K Q5 K M Q4 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest2.2 GB
PH
kappa 3 phi 3 4k instruct abliterated
Phi · failspy
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · qnixsynapse
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini Instruct
Phi · MaiDuong
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
KimLam phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 2
Phi · shuaigetw
Params2.78B
Context2K
Q4_K_M1.7 GB