Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
ihughes15234 phi35 kp dpo7epoch total
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi4 FT ai medical chatbot
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k instruct GGUF imatrix
Phi · QuantFactory
Params3.82B
Context4K
Smallest1.2 GB
Coding
PH
Phinance Phi 4 mini instruct finance uzbek multilingual v1
Phi · Josephgflowers
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
PH
wafl phi3 mini 4k
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
sqft sparsepeft phi 3 mini 4k 50 cs heu
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi 3 mini 500 combined
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
bunnycore Phi 3.5 Hyper Mix
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
MFANN abliterated phi2 merge unretrained
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 3.5 Mini Instruct SFT D_chosen Skywork Preference Xlarge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Samantha2.0 Phi3 Medium ita 16bit
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PH
maximusLLM phi 4b 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
tanzuml phi3 4k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
win10 phi 3.5 Sakura Yuzu v1.5
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi3-4x4b-v1
Phi · bartowski
Params11.1B
Context4K
Q4_K_M6.7 GB
GGUF
PH
Phi 3.5 mini it Q4 K L chunked
Phi · BoscoTheDog
Params3.82B
Context128K
Smallest2.5 GB
Coding
PH
Phi 3.5 Mini instruct_Uncensored
Phi · ZeroWw
Params3.82B
Context128K
Smallest4.2 GB
GGUF
PH
wwe180 Phi 3 medium 128k 27B lingyang v0.1
Phi · RichardErkhov
Params27.6B
Context128K
Q4_K_M16.9 GB
GGUF
PH
phi3-mini-demo-fine-tune-model
Phi · njaana
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 2 sft ultrachat full i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medmcqa question generation pharmacology lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 ThinkMode Fp16
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 1.5 Medical Diamond v4 Merged
Phi · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PH
wafl phi3.5 mini instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 reasoning plus gguf F16
Phi · pbhappliedsystems
Params14.7B
Context32K
Smallest29.3 GB
Reasoning

Keep browsing