Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
disi unibo nlp phi3.5 SFT medqa triples nographeval cot
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 50 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning Abliterated
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 4 ReasoningRP i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
third intellect Phi 3 mini 4k instruct orca math word problems 200k model 16bit
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 2 Layla v1 Chatml
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Reasoning Abliterated
Phi · DuoNeural
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 100 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
tuong nguyen prd Phi 3.1 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi-3-mini-4k-instruct-function-calling-assistant-spanish-pofi-v2
Phi · afrideva
Params3.82B
Context4K
Q4_K_M2.3 GB
CodingTool use
PH
Phi 3.5 MoE Instruct
Phi · mradermacher
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Barcenas 14b phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
orpo lora phi2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 bifrost sol 3.8B
Phi · Bifrost-AI
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
PH
Moxoff Phi3Mini PPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · BenevolenceMessiah
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Instruct Bioaligned
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi3.5 mini exp 825 uncensored
Phi · carsenk
Params3.82B
Context128K
Q4_K_M2.3 GB
Coding
PH
aifeifei798 Phi 3 song lyrics 1.1
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
e palmisano Phi3 ITA mini 4K instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
LocalAI functioncall phi 4 v0.2
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 2 Insurance_Qa Sft Lora
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Bioinspired Phi 3 Mini 4k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
sujithatz finbot phi3.5 merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing