Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
phi 4 Q5 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
PH
Phi 3 mini 128k instruct Q6 K
Phi · jamesburton
Params3.82B
Context128K
Smallest3.1 GB
PH
adapter phi 3 mini mental health
Phi · mgonzs13
Params—
Context4K
Smallest0.0 GB
PH
phi3-v3-gguf
Phi · ALI-B
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
ellah
Phi · RikenSh
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · Dexman04
Params14B
Context128K
Q4_K_M8.6 GB
PH
phi 1 5 Q4 K M
Phi · marroyo777
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
PH
phi 4 Q4 K M
Phi · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 ColdBrew 14B Test2
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 medium 4k instruct Q5 K M
Phi · ssmits
Params14B
Context4K
Smallest10.1 GB
PH
Phi4 Nvidia Coder
Phi · ykarout
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
joke finetome model gguf phi4 20260106 130529
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Abliterated
Phi · dievnquisher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi2 gsm8k
Phi · bunny0417
Params2.78B
Context2K
Smallest5.6 GB
PH
Phi 3 Medium 4k instruct_MedMCQA_v2_frequncy100_Seed2024 Fine Tuned
Phi · lin789
Params7M
Context—
Smallest0.0 GB
PH
Phi 3.5 Mini Instruct
Phi · RCorvalan
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 mini TitanFusion 0.4
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
GGUF BIOMED
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 3 math full fine tuned
Phi · Ebullioscopic
Params3.82B
Context4K
Q4_K_M0.1 GB
PH
Phi2 Story Generator
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Reasoning
Phi · reyanshgupta
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
showvikdbz phi 3.5 25k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
scm_phi3_16_v3
Phi · sebdg
Params3.82B
Context4K
Smallest7.6 GB
PH
phi3 gsm8k
Phi · zeref713
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · dekuthenerd
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Finetune
Phi · kaimi1616
Params14.7B
Context16K
Smallest29.3 GB
PH
phi2 ds trained
Phi · CodeXdhruv
Params2.78B
Context2K
Q4_K_M3.0 GB
PH
Phi 3.5 Mini Instruct
Phi · foxcyan
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
model 8bitgguf phi3.5 movie diff
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest4.1 GB