Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 4k Instruct
Phi · HideOnHouse
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 4 Q5 K M
Phi · ZoltrixAI
Params14.7B
Context16K
Smallest10.6 GB
Coding
PH
Phi 4 Mini Reasoning
Phi · JulianChang
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoningTool use
PH
dev test 1 20250722 231555
Phi · devparagiri
Params2.77B
Context2K
Smallest3.0 GB
GGUF
PH
phi 2
Phi · Wahlaalne
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
KimLanpuretext phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini v2024.07 128K Instruct
Phi · mukel
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi 2
Phi · ackerley
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 0
Phi · JoyboyBrian
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3 mini 4k instruct Q5 K M
Phi · alanrios2001
Params3.82B
Context4K
Smallest2.8 GB
Coding
PH
awelitoLLM phi 4b 128k
Phi · Mathieu-CR
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
phi 1 5
Phi · Nirajkanth
Params—
Context4K
Smallest0.0 GB
GGUF
PH
phi 4 2v2.192057 fastqz
Phi · muchuan-l
Params14.7B
Context16K
Smallest15.6 GB
Tool use
PH
llava phi 3 mini
Phi · Thejmimiia
Params3.82B
Context4K
Smallest2.3 GB
Vision
PH
Phi 4 Reasoning Plus
Phi · saneowl
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 3.5 Mini Instruct
Phi · CelesteImperia
Params3.82B
Context128K
Q4_K_M2.4 GB
Reasoning
PH
Phi medprob dental i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
MinaMila phi3 unlearning 4th 1e 5 1.0 0.5 0.25 0.5 epoch1
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
phi3 erp source supplier
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
alterf
Phi · alterf
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
phi 3.5 sakura yuzu v2.5
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4 FT func ep3
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · Grace-Zhang48
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 4 Mini Instruct
Phi · murean
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
ihughes15234 phi35 tictactoe dpo4epoch v5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 3 8bit Q16 0 gg
Phi · LeonardLangsdorf
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi2 finetuned
Phi · AKASH2393
Params2.78B
Context2K
Smallest1.6 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · Mayank-sharma108
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
lora
Phi · ndavidson
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
phi 4 calc
Phi · nakaba
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF

Keep browsing