Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi-3-mini-4k-instruct-finqa
Phi · hackertina
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 3.5 sakura yuzu v2
Phi · mradermacher
Params4.84B
Context4K
Q4_K_M3.0 GB
GGUF
PH
llava phi 2 3b
Phi · marianna13
Params2.78B
Context2K
Smallest5.6 GB
Vision
PH
Phi 4 Mini Reasoning
Phi · NikolayKozloff
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoningTool use
PH
phi 3.1 abliterated
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
MoxoffSpA Moxoff Phi3Mini KTO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
PHI 3.5 Mini ExPO
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
DeepThinkers Phi4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
somosnlp phi 2 LC
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Miyako 04
Phi · stablediffussion002
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3 medium 128k
Phi · nisten
Params14B
Context128K
Smallest7.5 GB
GGUF
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled4
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · dabr1
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi medmcqa question generation model i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 OpenHermes 2.5
Phi · olafgeibig
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
lora phi2 alpaca
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct Q4 0 GGUF PTBR
Phi · noxinc
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
alexshengzhili phi3 dpo 0908 preference 4 conference shuffled 2023
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 mini maths
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2
Phi · TMOU715
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · SandLogicTechnologies
Params14B
Context128K
Q4_K_M8.6 GB
Reasoning
PH
phi 2 pytdml
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
Coding
PH
Katuni4Ka Tiny Random Phi3
Phi · tensorblock
Params3M
Context4K
Smallest0.0 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Common
Phi · keitokei1994
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Neural Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mounjaro
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi4 noesis
Phi · dimsavva
Params14.7B
Context16K
Smallest29.3 GB
GGUF
PH
phi 4
Phi · kholiavko
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · LoneStriker
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Dpo Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing