Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi4 Indian Geography
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Reasoning Abliterated
Phi · ldostadi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 3 mini 128k instruct abliterated v3 Q4 K M
Phi · Gapsar
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
French Alpaca Phi 3 mini 4k instruct v1.0
Phi · jpacifico
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Kondara
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
TaliML PHI3 128K ITA V.1.0.FINAL
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · DuoNeural
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
contactextraction_zsj_tlm-bnb-4bit_gguf_0.0.10
Phi · ashokpoudel
Params3.82B
Context5K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q3 K M
Phi · roleplaiapp
Params14.7B
Context16K
Smallest7.4 GB
Coding
PH
Phi mts dialogue clinical note CC i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
sqft phi 3 mini 4k 30 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
phi3-Mini-Medical-Chat
Phi · srikar-v05
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi4 Turbochat Full
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
P3 mini v1
Phi · Ramikan-BR
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 Edge
Phi · Coobarha
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 mini instruct ShopRAG
Phi · LoganLeGrand
Params3.84B
Context128K
Smallest2.5 GB
CodingTool use
PH
Alpaca69B phi 2 absa semeval 2016
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Edge4 SQL Q4 K M
Phi · maroofiums
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi3 finedragon1 merged
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
rbgo Super phi 2 dpo
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
FinDPO Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Kenhktsui Nano Phi 115M v0.1
Phi · tensorblock
Params115M
Context1K
Smallest0.1 GB
GGUF
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · rubuntu
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
aongwachi phi 3.5 kbank
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi35_Medqa_Dpo_Merged
Phi · olusegunola
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi Lthy4
Phi · mradermacher
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
Phi4 Rp1
Phi · stablediffussion002
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo6epoch v2
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing