Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
GGUF
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
microsoft.Phi 4 Reasoning Vision 15B
Phi · DevQuasar
Params14.7B
Context32K
Smallest5.5 GB
ReasoningVision
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Dolphin-2.9.1-Phi-3-Kensho-4.5B
Phi · crusoeai
Params6.54B
Context4K
Q4_K_M4.0 GB
GGUF
PH
lexi coder v4.3
Phi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
PH
Phi 3 mini 3.8b 4Bit InstructionTuned Alpaca
Phi · Chituyi
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Hyper
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Bode
Phi · dagbs
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 medium 4k instruct
Phi · second-state
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 medium 128k instruct imatrix
Phi · hermes42
Params14B
Context128K
Q4_K_M8.6 GB
CodingTool use
PH
slim summary phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
phi3.5 gutenberg 4B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · mmnga
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
PH
Phi 3.5 mini ITA
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 14B
Phi · EasierAI
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
Phi-4-mini-reasoning
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
Coding
PH
Phi 3 Context Obedient RAG
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
calme-2.1-phi3.5-4b
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Mahou 1.2 phi 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
phi3 mini rebus solver fp16
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · SanctumAI
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

Keep browsing