Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
bhanudaybirla phi3 dapt
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 4 Q5 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest10.2 GB
Coding
PH
Phi 3 mini 128k instruct Q8 0
Phi · heisenbug
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Microsoft Phi 4 Q4 0
Phi · SamPurkis
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PH
Phi 3.5 mini instruct hermes fc json
Phi · vonjack
Params3.82B
Context128K
Smallest2.3 GB
Tool use
PH
phi 4 Q8 0
Phi · paultimothymooney
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
phi 4 Q8 0
Phi · OMP123
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
Adv DPO Phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
German RAG PHI 3.5 MINI 4B MERGED Long Context QA HESSIAN AI
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
Coding
PH
phi 2 OpenHermes 2.5
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
PH
igbo phi3 translator
Phi · nwokikeonyeka
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 2 GGUF fp16
Phi · ddh0
Params2.78B
Context2K
Smallest5.6 GB
GGUF
PH
phi 4 Q4 K M
Phi · namelessai
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 Reasoning
Phi · NikolayKozloff
Params14.7B
Context32K
Smallest8.4 GB
CodingReasoning
PH
Phi 3 medium 128k 10B lingyang v0.1 Q6 K
Phi · wwe180
Params10.6B
Context128K
Smallest8.7 GB
GGUF
PH
Phi 4 Reasoning Vision 15B
Phi · gaoqianshen
Params14.7B
Context32K
Smallest15.6 GB
ReasoningVision
PH
phinancial
Phi · marcusfridjohansson
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
bling phi 2 v0
Phi · Ajay-21
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
PH
model chain of thought phi 3.5 1
Phi · manasikhillare
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Tune Unsloth
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 4 Q2 K
Phi · thoriiiq
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
Phi medmcqa question generation microbiology lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4
Phi · 1bit-MONSTER
Params14.7B
Context16K
Smallest9.1 GB
GGUF
PH
Thytu Phi 2 Audio Super
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
Edge4 SQL CPU Q4 K M
Phi · maroof2424
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
lumynax reasoning phi4 mini
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi3 Jarvis Gguf
Phi · patilsp370
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing