Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · chatpdflocal
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 3 mini 128k vulkan
Phi · seanbailey518
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
joke finetome model gguf phi4 20260109 070918
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k base
Phi · Deeokay
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct q8
Phi · rhaymison
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
magnifi Phi3 intent v37 2 w unknown epoch 8 lr 0.002 r 16 a 8
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 128k instruct Rev2
Phi · ukung
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RachidAR
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 3 portuguese tom cat 4k instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
phi3 mini math Q4 K M
Phi · jrc
Params—
Context4K
Q4_K_M0.0 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · antoste
Params3.82B
Context128K
Smallest1.9 GB
Coding
PH
MoxoffSpA Moxoff Phi3Mini PPO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi3.5 Medicalchat Gguf
Phi · syubraj
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q8 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
Phi 4 14B ULTRA
Phi · ia4you
Params14.7B
Context16K
Smallest8.9 GB
Coding
PH
phi 4 Q6 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest12.0 GB
Coding
PH
Phi 3.5 mini Nepali Textbook QA
Phi · Saroj2004
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi2 FLAN 4M
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Merged
Phi · AndriLawrence
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 3 on mac Q2 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
Py phi 4 coder
Phi · MouezYazidi
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
peleke-phi-4
Phi · silicobio
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
ihughes15234 phi35 tictactoe pd dpo5epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K S
Phi · CHE-72
Params14B
Context128K
Smallest8.0 GB
Coding
PH
dre phi 3 4k
Phi · empgces
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
PH
Phi medmcqa question generation pharmacology lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Rosa v1 Phi 2
Phi · jeiku
Params2.78B
Context2K
Smallest1.2 GB
GGUF
PH
CEREBORN german
Phi · thomheinrich
Params3.82B
Context128K
Smallest7.6 GB
CodingReasoning
PH
Phi 3 Mini 4k Instruct
Phi · polyverse
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding

Keep browsing