Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi3 naval f16
Phi · arjunaar2789
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3 medium 128k instruct Q5 K M
Phi · e2jhiubyiiyvw
Params14B
Context128K
Smallest10.1 GB
PH
scm_phi3_q8_v3
Phi · sebdg
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 4 Mini Instruct
Phi · Grace-Zhang48
Params3.84B
Context128K
Smallest2.1 GB
PH
Phi 3.5 MoE Instruct
Phi · FullnameNameUser
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
Phi medner finetuned
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
threadyLLM 14b 128k
Phi · awels
Params14B
Context128K
Smallest27.9 GB
PH
mouadenna phi 3 mini legal
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
contactextraction zsj tlm bnb 4bit gguf 0.0.11
Phi · ashokpoudel
Params3.82B
Context5K
Q4_K_M2.3 GB
PH
Phi 4 Abliterated
Phi · syedaic
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 4 Mini 6b Merge
Phi · Jonah-M
Params6.25B
Context128K
Smallest4.6 GB
PH
phi3_GGUF_merged_5_epoch_quantized
Phi · auchoi
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
model
Phi · SSepiol
Params3.82B
Context4K
Smallest4.1 GB
PH
magnifi Phi3 intent v47 2 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 3 ProductRecommendations ShareGPT
Phi · srikar-v05
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Trim v0.2
Phi · mradermacher
Params6.48B
Context16K
Q4_K_M4.0 GB
PH
convex 20250806 201940
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 4 Reasoning Plus
Phi · ghostoverflow
Params14.7B
Context32K
Smallest15.6 GB
PH
gguf sharded Phi 3 mini 4k instruct iMat
Phi · Felladrin
Params3.82B
Context4K
Smallest2.8 GB
PH
Phi 4 Mini Instruct
Phi · motionlabs
Params3.84B
Context128K
Smallest1.9 GB
PH
convex 3 20250801 000036
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
PH
phi4RAG
Phi · nadiva1243
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi3-mini-jql
Phi · rahulshetty
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 Mini 4k Instruct
Phi · gutsartificial
Params3.82B
Context4K
Smallest7.6 GB
PH
phi 4 reasoning vision q5 k m
Phi · Manojb
Params14.7B
Context32K
Smallest10.6 GB
PH
phi3 128k 6b Q8 0
Phi · NikolayKozloff
Params5.86B
Context128K
Smallest6.2 GB
PH
phi 3.1 abliterated Q4 K M
Phi · MugenYume
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.1 mini 4k instruct Q4 0 4 4
Phi · flyfishstudio
Params3.82B
Context4K
Smallest2.2 GB
PH
phi 4
Phi · Sri-Vigneshwar-DJ
Params14.7B
Context16K
Smallest29.3 GB
PH
phi 3.5 mini fulldataset
Phi · Mernaaaa
Params3.82B
Context128K
Q4_K_M2.3 GB