Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
grounded ai phi3.5 rag relevance judge merge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
wenlianghuang Phi3 finance Matt
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 2
Phi · andrijdavid
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
UNCENSORED Phi 3 mini 4k geminified Q4 K M
Phi · v8karlo
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi2 Humanizer Merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
TOI 157 Phi 4 Reasoning Mini
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
RYS Phi 3 Medium 4k Instruct
Phi · mradermacher
Params17.7B
Context4K
Q4_K_M10.8 GB
GGUF
PH
Phi 3.5 24 10 06 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4
Phi · second-state
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 Mirage Sol Reasoning 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
phi4 MedIT 10B o1
Phi · mkurman
Params10.3B
Context16K
Smallest10.9 GB
Coding
PH
Phi 4 o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning
PH
Luminis phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Blake XTM Arc 3B V1
Phi · Flexan
Params2.78B
Context2K
Q4_K_M1.7 GB
ReasoningTool use
PH
phi 3 mini 4k gamedev
Phi · theprint
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 128k instruct iMat
Phi · qwp4w3hyb
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
phi2 medical i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
lexi coder v4.1
Phi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · DuoNeural
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Moxoff Phi3Mini DPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 mini ITA i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Lthy4
Phi · bartowski
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
torchlight phi4 mini
Phi · samadpls
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · GPT4All-Community
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Flow Judge v0.1
Phi · flowaicom
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing