Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
phi 3 22b
Phi · mradermacher
Params22.1B
Context128K
Q4_K_M13.6 GB
GGUF
PH
Phi-4-Argunaut-1-HIRPO
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
ReasoningTool use
PH
calme 2.3 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Vision Instruct
Phi · abetlen
Params3.82B
Context128K
Smallest4.1 GB
Vision
PH
Phi Mini MoE
Phi · gabriellarson
Params7.65B
Context4K
Q4_K_M5.0 GB
GGUF
PH
LocalAI functioncall phi 4 v0.1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi-3-mini-4k-june-symbolic-sentiment-analysis-july-03-2024-2-epoch
Phi · seandearnaley
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
Phi 4 mini instruct
Phi · AtomicChat
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
CoLoR Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
phi 4 abliterated Orion 18B i1
Phi · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
GGUF
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
PH
Phi 3.5 mini 3.8B ArliAI RPMax v1.1
Phi · ArliAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4.React.Turn.V2.Full
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
1 800 SHARED TASKS PHI3 Medium NLI 16bit
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi 3 mini 4k instruct function calling
Phi · nold
Params3.82B
Context4K
Q4_K_M2.4 GB
Tool use
PH
phi 4 abliterated Orion 18B
Phi · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
GGUF
PH
phi 3.5 mini 3.8b instruct
Phi · lm-kit
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 128k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi4 multimodal quantisized
Phi · ShayanCyan
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool useVision
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
GGUF
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3.5 Mini Instruct Horse Trainer
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
CodingReasoning
PH
Phi 4 Mini Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use

Keep browsing