Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
PH
microsoft.Phi 4 Reasoning Vision 15B
Phi · DevQuasar
Params14.7B
Context32K
Smallest5.5 GB
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
PH
Dolphin-2.9.1-Phi-3-Kensho-4.5B
Phi · crusoeai
Params6.54B
Context4K
Q4_K_M4.0 GB
PH
lexi coder v4.3
Phi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
PH
Phi 3 mini 3.8b 4Bit InstructionTuned Alpaca
Phi · Chituyi
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Hyper
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi Bode
Phi · dagbs
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 medium 4k instruct
Phi · second-state
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
PH
slim summary phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
PH
phi3.5 gutenberg 4B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.1 mini 128k instruct
Phi · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 mini ITA
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 14B
Phi · EasierAI
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
PH
Phi 3 Context Obedient RAG
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Mahou 1.2 phi 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
PH
phi3 mini rebus solver fp16
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · SanctumAI
Params3.82B
Context128K
Q4_K_M2.4 GB