Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 Q5 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
Coding
PH
Phi 3 mini 128k instruct Q6 K
Phi · jamesburton
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
adapter phi 3 mini mental health
Phi · mgonzs13
Params—
Context4K
Smallest0.0 GB
GGUF
PH
phi3-v3-gguf
Phi · ALI-B
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
ellah
Phi · RikenSh
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · Dexman04
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
phi 1 5 Q4 K M
Phi · marroyo777
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
PH
phi 4 Q4 K M
Phi · NikolayKozloff
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 ColdBrew 14B Test2
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 medium 4k instruct Q5 K M
Phi · ssmits
Params14B
Context4K
Smallest10.1 GB
Coding
PH
Phi4 Nvidia Coder
Phi · ykarout
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
joke finetome model gguf phi4 20260106 130529
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Abliterated
Phi · dievnquisher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi2 gsm8k
Phi · bunny0417
Params2.78B
Context2K
Smallest5.6 GB
GGUF
PH
Phi 3 Medium 4k instruct_MedMCQA_v2_frequncy100_Seed2024 Fine Tuned
Phi · lin789
Params7M
Context—
Smallest0.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RCorvalan
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 mini TitanFusion 0.4
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
GGUF BIOMED
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 3 math full fine tuned
Phi · Ebullioscopic
Params3.82B
Context4K
Q4_K_M0.1 GB
GGUF
PH
Phi2 Story Generator
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · reyanshgupta
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
showvikdbz phi 3.5 25k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
scm_phi3_16_v3
Phi · sebdg
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi3 gsm8k
Phi · zeref713
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · dekuthenerd
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Finetune
Phi · kaimi1616
Params14.7B
Context16K
Smallest29.3 GB
GGUF
PH
phi2 ds trained
Phi · CodeXdhruv
Params2.78B
Context2K
Q4_K_M3.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · foxcyan
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
model 8bitgguf phi3.5 movie diff
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest4.1 GB
GGUF

Keep browsing