Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
sqft phi 3 mini 4k 40 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
moriire phi 2 medical chat v0 model
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Jackterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
fine-tuned-Phi-3-mini-4k-instruct
Phi · hackertina
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
microsoft phi 2 trained abliterated QA 1960 all modules merged
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 60 math heu i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Ektome Phi 3 Mini 4k Instruct PristinelyUncensored
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Moxoff Phi3Mini ORPO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
GRAG PHI 3.5 MINI 4B MERGED HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
NuExtract
Phi · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Model Stock
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
MarcelPower Phi 3.5 CodeAlpaca18k FFT
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
MoxoffSpA Moxoff Phi3Mini ORPO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Avg
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi_2_Zh
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · LiteLLMs
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
M1LL1X microsoft phi 3 5 mini trained witness normal QA 400 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
arnavgrg phi 2 nf4 fp16 upscaled
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 mini 4k it spanish pofi Q4 K M
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M4.6 GB
GGUF
PH
Phi 3.5 Mini Instruct_Unslothcpy
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi4.Turn.R1Distill.16bit
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
thucdangvan020999 phi2 2.2B mergkit prunme
Phi · RichardErkhov
Params2.23B
Context2K
Q4_K_M1.4 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Cream Phi 3 14B v1 i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi Elothir i1
Phi · mradermacher
Params5.14B
Context2K
Q4_K_M3.2 GB
GGUF
PH
MaziyarPanahi phi 2 logical sft
Phi · RichardErkhov
Params2.78B
Context4K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 RP v0
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Roleplay
PH
Phinance Phi 3.5 mini instruct finance v0.3
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
MiniMedMind Phi 2 2.7B Instruct Medical Conversational
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing