Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 4 Mini Instruct
Phi · liodon-ai
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Orion Zhen.Phi 4 Abliterated
Phi · DevQuasar-6
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
ashmitkx phi 2 instruct
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi arxiv math instruct
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi medquad inheritance
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.25
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
PHI4 SFT DE THINKING
Phi · mradermacher
Params14.7B
Context34K
Q4_K_M8.9 GB
PH
cates phi3 1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
sqft sparsepeft phi 3 mini 4k 30 math heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Sabyasachi phi 3 mini 4k finetuned full
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
ostapbodnar Phi3.5 mini ua artificial
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
dcipheranalytics phi 2 pii bbi
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
M1LL1X microsoft phi 3 5 mini trained witness normal QA 1960 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 2 2.7B Instruct Medical Conversational
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Instruct
Phi · tatsuyaaaaaaa
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
unsloth phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
abacaj phi 2 super
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 1 5
Phi · martineden
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
phi 2
Phi · martineden
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
LoftQ phi 2 4bit 64rank
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Bioinspired Phi 3 mini 128k
Phi · lamm-mit
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3 Medium 4k Instruct Abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 4k Instruct Bnb 4bit
Phi · kms7530
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 2 pytdml
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
PH
sqft phi 3 mini 4k 60 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Mahoream Phi 3 14B 128k
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB