Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3.5 Mini Instruct
Phi · chatpdflocal
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 3 mini 128k vulkan
Phi · seanbailey518
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
joke finetome model gguf phi4 20260109 070918
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 mini 4k base
Phi · Deeokay
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 3 portuguese tom cat 4k instruct q8
Phi · rhaymison
Params3.82B
Context4K
Smallest4.1 GB
PH
magnifi Phi3 intent v37 2 w unknown epoch 8 lr 0.002 r 16 a 8
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 medium 128k instruct Rev2
Phi · ukung
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3.5 Mini Instruct
Phi · RachidAR
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 3 portuguese tom cat 4k instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
PH
phi3 mini math Q4 K M
Phi · jrc
Params—
Context4K
Q4_K_M0.0 GB
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.9 GB
PH
MoxoffSpA Moxoff Phi3Mini PPO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi3.5 Medicalchat Gguf
Phi · syubraj
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 4 Q8 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 4 14B ULTRA
Phi · ia4you
Params14.7B
Context16K
Smallest8.9 GB
PH
phi 4 Q6 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest12.0 GB
PH
Phi 3.5 mini Nepali Textbook QA
Phi · Saroj2004
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi2 FLAN 4M
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Merged
Phi · AndriLawrence
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 3 on mac Q2 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest1.4 GB
PH
Py phi 4 coder
Phi · MouezYazidi
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
peleke-phi-4
Phi · silicobio
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
ihughes15234 phi35 tictactoe pd dpo5epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3 medium 128k instruct Q4 K S
Phi · CHE-72
Params14B
Context128K
Smallest8.0 GB
PH
dre phi 3 4k
Phi · empgces
Params1.1B
Context4K
Q4_K_M0.7 GB
PH
Phi medmcqa question generation pharmacology lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Rosa v1 Phi 2
Phi · jeiku
Params2.78B
Context2K
Smallest1.2 GB
PH
CEREBORN german
Phi · thomheinrich
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · polyverse
Params3.82B
Context4K
Q4_K_M2.4 GB