Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Xlarge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3.1 mini 4k 3.8b instruct
Phi · lm-kit
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi3 3.5 OH SFT 2
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning Heretic
Phi · SimplySara
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.500000
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
ihughes15234 phi 3 5 mini 20k con4 bthrough
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
lole25 phi 2 sft ultrachat full
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
test ph4
Phi · kholiavko
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k instruct V1
Phi · AI-Engine
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
Phi 3.5 mini ITA
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
nnikolovskii phi 3.5 16b quantized
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Sayan01/Phi3-TL-ORCA-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Phi4 Slerp3 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
win10 phi 3.5 sakura yuzu v3.0
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi3 3.5 OH SFT
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
susnato phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 50 cs heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi-4-Argunaut-1-SPIN
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
ReasoningTool use
PH
phi4_30_epoch_PHP
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3 toxicity judge merge
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
orpo lora phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct Obliterated Zero
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
FinaPolat phi 3.5 mini ner
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ahsbdcpu Hypertension fusion phi 1.5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 3.5 Mini Instruct PERT
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 reasoning plus gguf Q4 K M
Phi · pbhappliedsystems
Params14.7B
Context32K
Smallest9.1 GB
Reasoning
PH
HTML Pruner Phi 3.8B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
srinathvaida phi 3.5 text2sql Instruct Finetune test
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing