Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
rasyosef phi 1 5 sft v4 merged
Phi · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
PH
Cinder Phi 2 Test 1
Phi · Josephgflowers
Params2.78B
Context2K
Smallest5.6 GB
PH
phi 2 code instruct
Phi · parsak
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi medmcqa question generation pediatrics lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Candle phi 2
Phi · DanielClough
Params2.78B
Context—
Smallest0.9 GB
PH
Neural Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Model Stock v3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini Instruct
Phi · neopolita
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 6b 4k instruct
Phi · mradermacher
Params6.09B
Context4K
Q4_K_M3.8 GB
PH
Phi 3.5 Hyper Mix IQ4 XS
Phi · bunnycore
Params3.82B
Context128K
Smallest2.1 GB
PH
Phi 3 medium 128k instruct
Phi · MoMonir
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 4 Reasoning Line 14b Karcher
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Phituguese 3b q4 k m
Phi · GuiCas
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
prithivMLmods.Phi 4 Empathetic
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 4 Q4 K M
Phi · ginesew43
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Obelix Phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
microsoft phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
PH
Phi 4 Model Stock v2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Samantha2.0 Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 300 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Sayan01/Phi3-TL-ORCAMEL-5
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
Sayan01/Phi3-TL-ORCAMEL-KL
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
njprogrammer Phi 3.5 Mounjaro ep1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Maika Buddy 3B8 Phi3
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4
Phi · Tuxifan
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3.5 Small Instruct UNOFFICAL
Phi · mradermacher
Params10.6B
Context128K
Q4_K_M6.6 GB