Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 Mini Instruct
Phi · liodon-ai
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Orion Zhen.Phi 4 Abliterated
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
ashmitkx phi 2 instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi arxiv math instruct
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi medquad inheritance
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.25
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
PHI4 SFT DE THINKING
Phi · mradermacher
Params14.7B
Context34K
Q4_K_M8.9 GB
Reasoning
PH
cates phi3 1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 30 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Sabyasachi phi 3 mini 4k finetuned full
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ostapbodnar Phi3.5 mini ua artificial
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
dcipheranalytics phi 2 pii bbi
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained witness normal QA 1960 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi 2 2.7B Instruct Medical Conversational
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · tatsuyaaaaaaa
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
unsloth phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
abacaj phi 2 super
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 1 5
Phi · martineden
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
phi 2
Phi · martineden
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
LoftQ phi 2 4bit 64rank
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Bioinspired Phi 3 mini 128k
Phi · lamm-mit
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
Phi 3 Medium 4k Instruct Abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct Bnb 4bit
Phi · kms7530
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 2 pytdml
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
GGUF
PH
sqft phi 3 mini 4k 60 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Mahoream Phi 3 14B 128k
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing