Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 mini 128k instruct Q8 0
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 2 Finetuned Qa Medmcqa
Phi · farikaw599
Params26M
Context—
Smallest0.1 GB
GGUF
PH
Einstein v6.1 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K M
Phi · ElMater06
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
L3Utterfly Phi 2 Layla v1
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
model 1125 8bit
Phi · bau0221
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Base 1102
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi therapist chat v1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
bhanudaybirla phi3 dapt3
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ggml phi 4 reasoning vision 15b q4 k
Phi · Manojb
Params14.7B
Context32K
Smallest9.7 GB
ReasoningVision
PH
phi 3 tiny random
Phi · tensorblock
Params1M
Context128K
Smallest0.0 GB
GGUF
PH
Phi 4 Reasoning
Phi · ghostoverflow
Params14.7B
Context32K
Smallest15.6 GB
CodingReasoning
PH
phi 2 Q4 K M
Phi · codegood
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
dfda
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
joke finetome model gguf phi4 20260106 065852
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi-3-mini_GGUF-GameStory
Phi · frikh-said
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K M
Phi · Sc0m3r
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3 medium 4k instruct abliterated Q4 K M
Phi · informatiker
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
L3Utterfly Phi 2 Layla v1 Chatml
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
SL constitutional law qa phi 4
Phi · Shifaur
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · jagan546
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi4 grpo gguf q8
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · yh-yao
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi SoSerious Mini V1 Q8 0 Q6 K Q5 K M Q4 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
kappa 3 phi 3 4k instruct abliterated
Phi · failspy
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · qnixsynapse
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Mini Instruct
Phi · MaiDuong
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
KimLam phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2
Phi · shuaigetw
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing