Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi3 naval f16
Phi · arjunaar2789
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 medium 128k instruct Q5 K M
Phi · e2jhiubyiiyvw
Params14B
Context128K
Smallest10.1 GB
Coding
PH
scm_phi3_q8_v3
Phi · sebdg
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Grace-Zhang48
Params3.84B
Context128K
Smallest2.1 GB
CodingTool use
PH
Phi 3.5 MoE Instruct
Phi · FullnameNameUser
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
Phi medner finetuned
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
threadyLLM 14b 128k
Phi · awels
Params14B
Context128K
Smallest27.9 GB
GGUF
PH
mouadenna phi 3 mini legal
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
contactextraction zsj tlm bnb 4bit gguf 0.0.11
Phi · ashokpoudel
Params3.82B
Context5K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Abliterated
Phi · syedaic
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 4 Mini 6b Merge
Phi · Jonah-M
Params6.25B
Context128K
Smallest4.6 GB
Tool use
PH
phi3_GGUF_merged_5_epoch_quantized
Phi · auchoi
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
model
Phi · SSepiol
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
magnifi Phi3 intent v47 2 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3 ProductRecommendations ShareGPT
Phi · srikar-v05
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Trim v0.2
Phi · mradermacher
Params6.48B
Context16K
Q4_K_M4.0 GB
GGUF
PH
convex 20250806 201940
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 4 Reasoning Plus
Phi · ghostoverflow
Params14.7B
Context32K
Smallest15.6 GB
CodingReasoning
PH
gguf sharded Phi 3 mini 4k instruct iMat
Phi · Felladrin
Params3.82B
Context4K
Smallest2.8 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · motionlabs
Params3.84B
Context128K
Smallest1.9 GB
CodingTool use
PH
convex 3 20250801 000036
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
phi4RAG
Phi · nadiva1243
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi3-mini-jql
Phi · rahulshetty
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · gutsartificial
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 4 reasoning vision q5 k m
Phi · Manojb
Params14.7B
Context32K
Smallest10.6 GB
ReasoningVision
PH
phi3 128k 6b Q8 0
Phi · NikolayKozloff
Params5.86B
Context128K
Smallest6.2 GB
GGUF
PH
phi 3.1 abliterated Q4 K M
Phi · MugenYume
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.1 mini 4k instruct Q4 0 4 4
Phi · flyfishstudio
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
phi 4
Phi · Sri-Vigneshwar-DJ
Params14.7B
Context16K
Smallest29.3 GB
Coding
PH
phi 3.5 mini fulldataset
Phi · Mernaaaa
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing