Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 mini 4k instruct Q4 K S
Phi · yh-yao
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 3 therepy
Phi · Ductx
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
SauerkrautLM Phi 3 Medium
Phi · Marlon81
Params14B
Context4K
Smallest7.9 GB
GGUF
PH
Phi 3.1 mini 4k instruct Q4 0 4 8
Phi · flyfishstudio
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
Moxoff Phi3Mini KTO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3.5 Donegguf
Phi · karasu000
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Thetima4
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi3_Sharegpt_Finetuned
Phi · thisisdev
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi3 asp
Phi · knightluffy
Params3.88B
Context128K
Smallest4.1 GB
GGUF
PH
phi3 robotics lora v2
Phi · aslivishaal
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi4 file explain
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 4 Abliterated
Phi · nguyenthilaitrieulong
Params14.7B
Context16K
Smallest12.0 GB
Coding
PH
Phi 3 medium 4k instruct Q8 0
Phi · ssmits
Params14B
Context4K
Smallest14.8 GB
Coding
PH
phi 4 q8 0
Phi · doaonduty
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
model 16bitgguf phi3.5 movie diff
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi mts dialogue clinical note GENHX
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.1 Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
phi3 drone model
Phi · manhvuvan
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Lingrei
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 4 Rp v1 Lora
Phi · Cran-May
Params66M
Context—
Smallest0.3 GB
GGUF
PH
buildsnpper chatbot Q4 K M
Phi · bricksandbotltd
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi3 robotics lora
Phi · aslivishaal
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 ReasoningRP Q2 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest5.6 GB
Reasoning
PH
phi 2.four wheeler dataset finetuned
Phi · STGYO
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
SauerkrautLM-Phi-3-medium
Phi · Marlon81
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
phi 4 Q4 K M
Phi · airbass
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi tuned lora
Phi · bakch92
Params28M
Context—
Smallest0.1 GB
GGUF
PH
phi3-fine-GGUF
Phi · marua15
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3 mini
Phi · chrislazar25
Params3.82B
Context4K
Smallest2.4 GB
Coding
PH
aigf-phi3-mini-v4
Phi · pranav79
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing