Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
sqft phi 3 mini 4k 40 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
moriire phi 2 medical chat v0 model
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Jackterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
fine-tuned-Phi-3-mini-4k-instruct
Phi · hackertina
Params3.82B
Context4K
Smallest7.6 GB
PH
microsoft phi 2 trained abliterated QA 1960 all modules merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
sqft sparsepeft phi 3 mini 4k 60 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Ektome Phi 3 Mini 4k Instruct PristinelyUncensored
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Moxoff Phi3Mini ORPO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
GRAG PHI 3.5 MINI 4B MERGED HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
NuExtract
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
MarcelPower Phi 3.5 CodeAlpaca18k FFT
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
MoxoffSpA Moxoff Phi3Mini ORPO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Avg
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi_2_Zh
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 mini 128k instruct
Phi · LiteLLMs
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
M1LL1X microsoft phi 3 5 mini trained witness normal QA 400 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
arnavgrg phi 2 nf4 fp16 upscaled
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 3 mini 4k it spanish pofi Q4 K M
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M4.6 GB
PH
Phi 3.5 Mini Instruct_Unslothcpy
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi4.Turn.R1Distill.16bit
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
thucdangvan020999 phi2 2.2B mergkit prunme
Phi · RichardErkhov
Params2.23B
Context2K
Q4_K_M1.4 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Cream Phi 3 14B v1 i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi Elothir i1
Phi · mradermacher
Params5.14B
Context2K
Q4_K_M3.2 GB
PH
MaziyarPanahi phi 2 logical sft
Phi · RichardErkhov
Params2.78B
Context4K
Q4_K_M1.7 GB
PH
Phi 4 RP v0
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phinance Phi 3.5 mini instruct finance v0.3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
MiniMedMind Phi 2 2.7B Instruct Medical Conversational
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB