Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · mrmage
Params3.82B
Context128K
Smallest2.0 GB
Coding
PH
Phi medprob pharmacology i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medprob pathology
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
magnifi Phi3 intent v46 2 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
IntelLabs sqft phi 3 mini 4k 50 base
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
phi3_finetuned_40x3
Phi · madushan99
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · goodasdgood
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct bf16
Phi · ddh0
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 0
Phi · CHE-72
Params14B
Context128K
Smallest7.9 GB
Coding
PH
KimLam phi 2 zh.v1
Phi · elliotthwangmsa
Params2.78B
Context2K
Smallest3.0 GB
GGUF
PH
phi 2 lora cfr
Phi · unileon-robotics
Params2.78B
Context2K
Smallest2.3 GB
Coding
PH
vince62s phi 2 psy
Phi · viethang
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
KimLam phi 2 zh.v2
Phi · elliotthwangmsa
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 on mac Q3 K L
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.1 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B SFT HESSIAN AI Q8 0
Phi · avemio
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
waza router v1
Phi · Wazagiro
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
microsoft phi 2
Phi · easynet
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 Q3 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest6.5 GB
CodingRoleplay
PH
adamw 8bit
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
maximusLLM 14b 128k
Phi · awels
Params14B
Context128K
Smallest27.9 GB
GGUF
PH
dolphin 2.9.2 Phi 3 Medium i1
Phi · Iambackup
Params14B
Context4K
Smallest11.5 GB
CodingTool use
PH
Phi4Pro
Phi · hunter0777
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
phi 4
Phi · AI-Engine
Params14.7B
Context16K
Smallest7.9 GB
GGUF
PH
tf phi43.5 q4
Phi · TheHost
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
CyberRott 1.2 mini
Phi · johnknevescarrijo
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi3 1B OWN CLM
Phi · mradermacher
Params1.01B
Context2K
Q4_K_M0.6 GB
GGUF
PH
phi3 wbn
Phi · adhirajpandey
Params3.82B
Context128K
Smallest2.4 GB
Coding
PH
Phi4 Mini Instruct 4.4b
Phi · mradermacher
Params4.49B
Context128K
Q4_K_M3.4 GB
Tool use
PH
Phi 3 Phituguese 3b q8 0
Phi · GuiCas
Params3.82B
Context4K
Smallest4.1 GB
GGUF

Keep browsing