Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
bhanudaybirla phi3 dapt
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 4 Q5 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · heisenbug
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest1.4 GB
PH
Microsoft Phi 4 Q4 0
Phi · SamPurkis
Params14.7B
Context16K
Smallest8.4 GB
PH
Phi 3.5 mini instruct hermes fc json
Phi · vonjack
Params3.82B
Context128K
Smallest2.3 GB
PH
phi 4 Q8 0
Phi · paultimothymooney
Params14.7B
Context16K
Smallest15.6 GB
PH
phi 4 Q8 0
Phi · OMP123
Params14.7B
Context16K
Smallest15.6 GB
PH
Adv DPO Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
German RAG PHI 3.5 MINI 4B MERGED Long Context QA HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
PH
phi 2 OpenHermes 2.5
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
igbo phi3 translator
Phi · nwokikeonyeka
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 2 GGUF fp16
Phi · ddh0
Params2.78B
Context2K
Smallest5.6 GB
PH
phi 4 Q4 K M
Phi · namelessai
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
PH
Phi 3 medium 128k 10B lingyang v0.1 Q6 K
Phi · wwe180
Params10.6B
Context128K
Smallest8.7 GB
PH
Phi 4 Reasoning Vision 15B
Phi · gaoqianshen
Params14.7B
Context32K
Smallest15.6 GB
PH
phinancial
Phi · marcusfridjohansson
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
bling phi 2 v0
Phi · Ajay-21
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
model chain of thought phi 3.5 1
Phi · manasikhillare
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Tune Unsloth
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 4 Q2 K
Phi · thoriiiq
Params14.7B
Context16K
Smallest5.5 GB
PH
Phi medmcqa question generation microbiology lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 4
Phi · 1bit-MONSTER
Params14.7B
Context16K
Smallest9.1 GB
PH
Thytu Phi 2 Audio Super
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
PH
Edge4 SQL CPU Q4 K M
Phi · maroof2424
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
lumynax reasoning phi4 mini
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi3 Jarvis Gguf
Phi · patilsp370
Params3.82B
Context4K
Q4_K_M2.3 GB