Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
rasyosef phi 1 5 sft v4 merged
Phi · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Cinder Phi 2 Test 1
Phi · Josephgflowers
Params2.78B
Context2K
Smallest5.6 GB
Coding
PH
phi 2 code instruct
Phi · parsak
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled4
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medmcqa question generation pediatrics lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Candle phi 2
Phi · DanielClough
Params2.78B
Context—
Smallest0.9 GB
GGUF
PH
Neural Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Model Stock v3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · neopolita
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 6b 4k instruct
Phi · mradermacher
Params6.09B
Context4K
Q4_K_M3.8 GB
GGUF
PH
Phi 3.5 Hyper Mix IQ4 XS
Phi · bunnycore
Params3.82B
Context128K
Smallest2.1 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · MoMonir
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 4 Reasoning Line 14b Karcher
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3 Phituguese 3b q4 k m
Phi · GuiCas
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
prithivMLmods.Phi 4 Empathetic
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 4 Q4 K M
Phi · ginesew43
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Obelix Phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
microsoft phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · ZeroWw
Params3.84B
Context128K
Smallest2.6 GB
ReasoningTool use
PH
Phi 4 Model Stock v2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Samantha2.0 Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 300 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-5
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-KL
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
njprogrammer Phi 3.5 Mounjaro ep1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Maika Buddy 3B8 Phi3
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4
Phi · Tuxifan
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3.5 Small Instruct UNOFFICAL
Phi · mradermacher
Params10.6B
Context128K
Q4_K_M6.6 GB
GGUF

Keep browsing