Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
PH
phi 3 22b
Phi · mradermacher
Params22.1B
Context128K
Q4_K_M13.6 GB
PH
Phi-4-Argunaut-1-HIRPO
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
calme 2.3 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Vision Instruct
Phi · abetlen
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi Mini MoE
Phi · gabriellarson
Params7.65B
Context4K
Q4_K_M5.0 GB
PH
LocalAI functioncall phi 4 v0.1 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi-3-mini-4k-june-symbolic-sentiment-analysis-july-03-2024-2-epoch
Phi · seandearnaley
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 4 mini instruct
Phi · AtomicChat
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
CoLoR Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 1.5 Tele
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
phi 4 abliterated Orion 18B i1
Phi · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
PH
Phi 3.5 mini 3.8B ArliAI RPMax v1.1
Phi · ArliAI
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi4.React.Turn.V2.Full
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
1 800 SHARED TASKS PHI3 Medium NLI 16bit
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.4 GB
PH
Phi 3 mini 4k instruct function calling
Phi · nold
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 4 abliterated Orion 18B
Phi · mradermacher
Params18.1B
Context16K
Q4_K_M11.1 GB
PH
phi 3.5 mini 3.8b instruct
Phi · lm-kit
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 mini 128k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi4 multimodal quantisized
Phi · ShayanCyan
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
calme 2.3 phi3 4b
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 4
Phi · mmnga
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct Horse Trainer
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi-4-reasoning
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
PH
Phi 4 Mini Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB