Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 4k Instruct
Phi · SandLogicTechnologies
Params3.82B
Context4K
Q4_K_M2.4 GB
Reasoning
PH
TinyHermes phi 3 mini 4k instruct Q4 K M
Phi · MugenYume
Params3.82B
Context4K
Q4_K_M2.4 GB
Tool use
PH
Recipe phi4 v2
Phi · AlterEgo09
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi4 file explain v2
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
phi3.5 pro 10 08 Q8 0
Phi · win10
Params4.95B
Context128K
Smallest5.3 GB
GGUF
PH
phi 2
Phi · Nishant2609
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2
Phi · a1030788
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 on mac Q5 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
Phi-3-medium-4k-instruct-synthetic_text_to_sql-lora-3epochs-q5_k_m
Phi · felixml
Params14B
Context4K
Smallest9.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
PH
phi 1 5 Q4 K M
Phi · itlwas
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi 3 mini 128k instruct Q3 K S
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest1.7 GB
Coding
PH
Phi 3 mini 128k instruct Q4 0
Phi · ljnicol
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi4 Helloworld
Phi · Arrvindh
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi4 cybersec Q4 K M
Phi · daskalos-apps
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 2
Phi · Sailor01
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2
Phi · omusico
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 on mac Q8 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 mini 128k instruct Q6 K
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
phi4 adaptableIE v2
Phi · FinaPolat
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2
Phi · zcnrex
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · thurac2022
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Phituguese 3b gguf 16bit
Phi · GuiCas
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi4 finetune finetome 20260210 042638 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 song lyrics 1.1 Q8 0
Phi · aifeifei798
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
phi 4 Q2 K
Phi · SoonKwan
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
Phi 3.5 Mini Hyper Q4 K M
Phi · bunnycore
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct Q4 K M
Phi · felipe-carlos-ipms
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 3 mini 128k instruct mix spider bird 1 epoch Q4 0
Phi · paulo037
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3.5 Mini Instruct LoRA 32
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing