Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · itlwas
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Abliterated
Phi · UntitledMinister
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
phi3.5 mini ayq 20240826
Phi · qs-yq
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
sigilius phi 3 finetuned
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi4 func explain v2
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · lhambridge
Params3.84B
Context128K
Smallest3.2 GB
CodingTool use
PH
Phi 3.5 Mini Instruct
Phi · dispatchAI
Params3.82B
Context128K
Smallest2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · kaetemi
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi4 r1
Phi · kyr0
Params14B
Context—
Q4_K_M8.7 GB
Reasoning
PH
Phi 3 mini 128k instruct Q3 K L
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.1 GB
Coding
PH
Phi medquad geneticchanges i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
magnifi Phi3 intent v45 2 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo11epoch v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi3_GGUF_merged_5_epoch_no_quantized
Phi · auchoi
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi 4
Phi · llmware
Params14.7B
Context16K
Smallest9.3 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct Q5 K M GGUF PTBR
Phi · noxinc
Params3.82B
Context4K
Smallest2.8 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K M
Phi · ssmits
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · aditya-nutakki
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct Ko Hallucination Sft v0
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
KimLan phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3 mini 128k instruct Q3 K M
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.0 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · cminja
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phimotep
Phi · jacobi
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · Iambackup
Params14B
Context4K
Smallest11.5 GB
CodingTool use
PH
Phi 3 mini 128k instruct Q5 K M
Phi · huggingkot
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
TutorAI Chemistry Phi4
Phi · Abc8264
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · zsolx2
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
awelitoLLM phi 4b 128k
Phi · alinavlase
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
Phi 4 Heretic
Phi · EloyOn
Params14.7B
Context16K
Smallest10.2 GB
Coding
PH
phi2 hermes2
Phi · justinj92
Params2.78B
Context2K
Smallest2.0 GB
Tool use

Keep browsing