Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi3 ITA mini 4K instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
phi 4 therapy
Phi · Amod
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
PycodeAllTest
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi4_Sql_Finetuned
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · Cran-May
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
qgallouedec tiny Phi3ForCausalLM
Phi · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
PH
adapter Phi 3 mini 4k instruct code writing
Phi · zhhan
Params25M
Context—
Smallest0.1 GB
GGUF
PH
phi3 uncensored chat Q4 K M
Phi · chenly124
Params3.82B
Context4K
Q4_K_M2.4 GB
Roleplay
PH
French Alpaca Phi 3 beta
Phi · jpacifico
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 4 abliterated Orion 18B Q4 K M
Phi · Otakadelic
Params18.1B
Context16K
Q4_K_M11.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · inferenceport-ai
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Mahoream Phi 3 14B 128k i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Yukt Med
Phi · ayuag
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3
Phi · BaunRobotics
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
bhanudaybirla phi3 dapt2
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
llava phi 2 3b
Phi · Blombert
Params2.78B
Context2K
Smallest1.3 GB
Vision
PH
magnifi Phi3 intent v42 1 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 COT i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params5.63B
Context128K
Q4_K_M3.5 GB
GGUF
PH
Phi medprob anatomy i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
Tool use
PH
Phi3_tailwindcss
Phi · kalinkov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi medner finetuned i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 4k geminified
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
GGUF
PH
Phi medmcqa question generation pathology lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi3 industrial anomaly
Phi · ssam17
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
sqft sparsepeft phi 3 mini 4k 50 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Unsloth Phi 4 Reasoning Plus
Phi · tensorblock
Params14.7B
Context32K
Smallest5.5 GB
CodingReasoning
PH
Replete AI Phi 5B Test
Phi · RichardErkhov
Params5.3B
Context2K
Q4_K_M3.3 GB
GGUF
PH
zephyr spin phi3 data
Phi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing