Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi-3-mental-health-q4
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Iceball Phi 3.5 mini instruct shareGPT f16
Phi · EpistemeAI
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi medprob pharmacology
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi Mini MoE
Phi · noctrex
Params7.65B
Context4K
Smallest4.9 GB
PH
joke finetome model gguf phi4 20260112 081758
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 4 Reasoning Plus
Phi · BoyBarley
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
KimLan QA phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
dolphin 2.9.2 Phi 3 Medium Q4 K M
Phi · itlwas
Params14B
Context4K
Q4_K_M8.4 GB
PH
phi 3 on mac Q4 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
PH
Phi 3 mini 128k instruct Q4 K S
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.2 GB
PH
Test 1 20250730 213423
Phi · devparagiri
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
joke finetome model gguf phi4 20260106 093459
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
26_04_25GGUF
Phi · NikolaiRaitschew
Params3.82B
Context128K
Smallest7.6 GB
PH
phi 3.8 128k italian Q4 K M
Phi · Cali9994
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 mini instruct
Phi · sanjay920
Params4.27B
Context128K
Q4_K_M2.7 GB
PH
Tester
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
awelitoLLM phi 4b 128k
Phi · cl3ms
Params3.82B
Context128K
Smallest7.6 GB
PH
dfsdsf
Phi · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
PH
phi 2
Phi · Heng666
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · twright8
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi3-MB_q4_k_m
Phi · SSepiol
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Pycodetry
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Reasoning
Phi · ldostadi
Params3.84B
Context128K
Smallest2.8 GB
PH
phi emotune
Phi · AKASH2393
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3 Mini 128k Instruct
Phi · straino
Params3.82B
Context128K
Smallest2.8 GB
PH
phi 4 Q4 K M
Phi · gokul9
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3.5 Mini Instruct
Phi · mrmage
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · mrmage
Params3.82B
Context128K
Smallest1.9 GB
PH
Phi4 trained with func ver2
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Smallest2.2 GB