Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
aigf-phi3-mini-q4km
Phi · pranav79
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3 mental
Phi · andraeremla
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 2 Electrical Engineering
Phi · introvoyz041
Params2.78B
Context2K
Smallest1.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · jelawless
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
Phi medquad information i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
lexitron phi 4 3
Phi · jonelganalon
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · keisuke-miyako
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi4 trained with func explain
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
convex 20250801 092338
Phi · devparagiri
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
baseline front document mt4g
Phi · microtensor-io
Params3.84B
Context128K
Smallest2.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · shinkeonkim
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
UNCENSORED Phi 3 mini 4k geminified
Phi · Person0000
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Jackapan
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
lora model phi 3 beegol q4 k m
Phi · BeegolAI
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3.5 Sakura Yuzu
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4 trained with file explain
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi_4_14b_finetuned_graph_AAEC_gguf
Phi · KS112
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
DrSeg Phi3.5
Phi · segestic
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · flyfishstudio
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · liehuo
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Pruned
Phi · lemon-mint
Params11.9B
Context16K
Smallest6.5 GB
GGUF
PH
Phi 4 harupfall axis
Phi · mervinpraison
Params14.7B
Context16K
Q4_K_M8.9 GB
Tool use
PH
Phi 4 reasoning 8bit
Phi · shareit
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 3 Mini Fitness Trainer Q4_K_M
Phi · antoniowehbe
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 4 reasoning gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
slim boolean phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
Iceball Phi 3.5 mini instruct shareGPT v1.00 f16
Phi · EpistemeAI
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Walter-Klaus
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · oncu
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

Keep browsing