Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi-4-Argunaut-1-SPIN
Phi · DebateLabKIT
Params14.7B
Context16K
Q4_K_M8.9 GB
Tool use
PH
Meditation Agent Phi4
Phi · Sathman
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Jianping746
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
phi 4 Sky T1 data
Phi · yasserrmd
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
model 8bitgguf phi3.5 movie
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 1 5
Phi · walter-cavinaw
Params1.42B
Context2K
Smallest0.7 GB
GGUF
PH
phi 3 on mac Q4 K M
Phi · YorkieOH10
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · sunloaf228
Params3.84B
Context128K
Smallest3.2 GB
ReasoningTool use
PH
Phi 3 Medium 128k Instruct
Phi · mirelurker
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Phi 4 gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
phi 3 on mac Q5 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.8 GB
GGUF
PH
phi 3 on mac Q4 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 0
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · edsoncarvalhointuria
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 128k instruct Q2 K
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
phi 2
Phi · frankc350
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 4k instruct Q3 K L
Phi · yh-yao
Params3.82B
Context4K
Smallest2.1 GB
Coding
PH
phi3 3.8 128k italian v2 Q4 K M
Phi · nonsonpratico
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 4k instruct Q2 K
Phi · yesquiteno
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
SauerkrautLM Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
GGUF
PH
phi 4 Q4 K M
Phi · paramedik
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 ReasoningRP Q6 K
Phi · roleplaiapp
Params14.7B
Context16K
Smallest12.0 GB
Reasoning
PH
phi3.5 resume
Phi · Hathija
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · NyanDoggo
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
model 1125 q4k
Phi · bau0221
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · psgokulkrishnan
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi4 Carla X1 Beta
Phi · NCUT-AI
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi medmcqa question generation social n preventive medicine lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing