Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
disi unibo nlp phi3.5 SFT medqa triples nographeval cot
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 50 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 ReasoningRP i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
third intellect Phi 3 mini 4k instruct orca math word problems 200k model 16bit
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 2 Layla v1 Chatml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Mini Reasoning Abliterated
Phi · DuoNeural
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 100 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
tuong nguyen prd Phi 3.1 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.5 MoE Instruct
Phi · mradermacher
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Barcenas 14b phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
orpo lora phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 bifrost sol 3.8B
Phi · Bifrost-AI
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Moxoff Phi3Mini PPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · BenevolenceMessiah
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Instruct Bioaligned
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
phi3.5 mini exp 825 uncensored
Phi · carsenk
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
aifeifei798 Phi 3 song lyrics 1.1
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
e palmisano Phi3 ITA mini 4K instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
LocalAI functioncall phi 4 v0.2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 2 Insurance_Qa Sft Lora
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Bioinspired Phi 3 Mini 4k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
sujithatz finbot phi3.5 merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB