Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 3 8bit Q8 0
Phi · LeonardLangsdorf
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi2 CoT
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 reasoning vision q4 k s
Phi · Manojb
Params14.7B
Context32K
Smallest8.4 GB
ReasoningVision
PH
Phi 3 mini 4k instruct
Phi · Sparsh8123
Params3.82B
Context4K
Smallest2.4 GB
Coding
PH
Phi4 Codex
Phi · owenqwenllmwine
Params3.84B
Context128K
Smallest3.2 GB
GGUF
PH
scm_phi3_q8
Phi · sebdg
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
omega coder phi 3 mini 1K
Phi · samuelswandi
Params3.82B
Context4K
Smallest15.3 GB
Coding
PH
Phi 3 medium 128k instruct Q6 K
Phi · teemperor
Params14B
Context128K
Smallest11.5 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · nulledinstance
Params3.82B
Context4K
Smallest3.1 GB
Coding
PH
Vitas Ayurveda Phi3
Phi · Chaitu6969
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
phi 3 mini 4k instruct
Phi · elysiantech
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · janspoerer
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi medner consult historyandphy i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
magnifi Phi3 intent v43 1 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest10.2 GB
CodingReasoning
PH
phi 2223
Phi · stevendhasoi
Params3.82B
Context128K
Q4_K_M2.3 GB
Tool use
PH
phi 3.5 mini finetuned
Phi · shlok56
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3-mini-gguf
Phi · ALI-B
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 3.1 abliterated Q5 K M
Phi · MugenYume
Params3.82B
Context4K
Smallest2.8 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · vonjack
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · Vijay109
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · ldostadi
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 3.5 16bit
Phi · Swissmountain
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
phi 4 reasoning vision q4 K M
Phi · Manojb
Params14.7B
Context32K
Q4_K_M9.1 GB
ReasoningVision
PH
telehealth phi2
Phi · simmihugs
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
scm_phi3_q5_k_m_v3
Phi · sebdg
Params3.82B
Context4K
Smallest2.7 GB
GGUF
PH
phi 3 ProductRecommendations
Phi · srikar-v05
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · sheldonrobinson
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

Keep browsing