Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 mini 128k instruct IQ4 XS
Phi · gate369
Params3.82B
Context128K
Smallest2.1 GB
Coding
PH
adapter Phi 3 mini 4k instruct summarization
Phi · zhhan
Params25M
Context—
Smallest0.1 GB
GGUF
PH
sign language 20250823 190451
Phi · devparagiri
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · matrixportalx
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi4 noesis
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k instruct dansk Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
FijiTravelDemo
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K M
Phi · radia
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
PH
phi4 model qlora unsloth
Phi · MoreRareMorea
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2
Phi · Rashi999
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4
Phi · AmpereComputing
Params14.7B
Context16K
Smallest14.8 GB
GGUF
PH
fractalego phi3 3B ultrachat svd model
Phi · Koitenshin
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
BoccheseGiacomo phi 3.5 gsm8k partial
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Obelix Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Sonet RP
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Roleplay
PH
Phi 3.5 Mini Instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest4.2 GB
GGUF
PH
Phi medmcqa question generation physiology lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
fible 4 mini
Phi · Cwaude
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 mini 128k instruct Q2 K
Phi · SkyNotion
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
phi 3 people q4 k m
Phi · nayakayp
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 128k instruct Q5 K M
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
phi4 test
Phi · sebdg
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Dare Angel 4B
Phi · BornSaint
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · VladimirRH
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 mini 4k instruct
Phi · kyernboot
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
phi3 nl2bash canonical 17012026
Phi · ayertiam
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
KCAD SLM
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi3 mini 128k instruct ru
Phi · MACreative
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing