Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Gpt Oss 120b Distill Phi 4 14B GGUF
Phi · Jackrong
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 3 mini 4k instruct iMat
Phi · qwp4w3hyb
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 song lyrics 1.0
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
GGUF
PH
phi 4 mini uncensored
Phi · arzaan789
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
phi-3-mini-4k-python
Phi · theprint
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
PH
phi 3 22b 128k
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
chrisob94 phi 3 7b dissertation doc chat experiment 10 fold
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3 mini 4k python i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 mini 3.8b instruct
Phi · lm-kit
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
phi4
Phi · calcuis
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · second-state
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
phi 3 22b 128k i1
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
GGUF
PH
Phi 4 mini instruct heretic
Phi · richardyoung
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
dolphin-2.9.2-Phi-3-Medium
Phi · crusoeai
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k Python Vezora143k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 128k instruct abliterated v3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
GGUF
PH
llava phi 3 mini
Phi · xtuner
Params3.82B
Context4K
Smallest2.3 GB
Vision
PH
Phi 4 Heretic
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
TroyDoesAI Phi 3 Context Obedient RAG GGUF smashed
Phi · PrunaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Prox Phi 3 mini 128k i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
calme 2.1 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing