Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3.5 Mini Instruct SFT D_chosen Orca Skywork Capybara Xlarge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 3.1 mini 4k 3.8b instruct
Phi · lm-kit
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi3 3.5 OH SFT 2
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Reasoning Heretic
Phi · SimplySara
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.500000
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
ihughes15234 phi 3 5 mini 20k con4 bthrough
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
lole25 phi 2 sft ultrachat full
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
test ph4
Phi · kholiavko
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 mini 4k instruct V1
Phi · AI-Engine
Params3.82B
Context4K
Smallest1.4 GB
PH
Phi 3.5 mini ITA
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
nnikolovskii phi 3.5 16b quantized
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Sayan01/Phi3-TL-ORCA-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
Phi4 Slerp3 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
win10 phi 3.5 sakura yuzu v3.0
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi3 3.5 OH SFT
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
susnato phi 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
sqft sparsepeft phi 3 mini 4k 50 cs heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi-4-Argunaut-1-SPIN
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi4_30_epoch_PHP
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi3 toxicity judge merge
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
orpo lora phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct Obliterated Zero
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
FinaPolat phi 3.5 mini ner
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
ahsbdcpu Hypertension fusion phi 1.5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
PH
Phi 3.5 Mini Instruct PERT
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Borea Phi 3.5 Mini Instruct Jp
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4 reasoning plus gguf Q4 K M
Phi · pbhappliedsystems
Params14.7B
Context32K
Smallest9.1 GB
PH
HTML Pruner Phi 3.8B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
srinathvaida phi 3.5 text2sql Instruct Finetune test
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB