Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi-3-mental-health-q4
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
PH
Iceball Phi 3.5 mini instruct shareGPT f16
Phi · EpistemeAI
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi medprob pharmacology
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi Mini MoE
Phi · noctrex
Params7.65B
Context4K
Smallest4.9 GB
GGUF
PH
joke finetome model gguf phi4 20260112 081758
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · BoyBarley
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
KimLan QA phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
dolphin 2.9.2 Phi 3 Medium Q4 K M
Phi · itlwas
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
phi 3 on mac Q4 K S
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K S
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Test 1 20250730 213423
Phi · devparagiri
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
joke finetome model gguf phi4 20260106 093459
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
26_04_25GGUF
Phi · NikolaiRaitschew
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
phi 3.8 128k italian Q4 K M
Phi · Cali9994
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 mini instruct
Phi · sanjay920
Params4.27B
Context128K
Q4_K_M2.7 GB
GGUF
PH
Tester
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
awelitoLLM phi 4b 128k
Phi · cl3ms
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
dfsdsf
Phi · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
PH
phi 2
Phi · Heng666
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · twright8
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi3-MB_q4_k_m
Phi · SSepiol
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Pycodetry
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · ldostadi
Params3.84B
Context128K
Smallest2.8 GB
CodingReasoningTool use
PH
phi emotune
Phi · AKASH2393
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · straino
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
phi 4 Q4 K M
Phi · gokul9
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · mrmage
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · mrmage
Params3.82B
Context128K
Smallest1.9 GB
Coding
PH
Phi4 trained with func ver2
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3.5 Mini instruct_Uncensored
Phi · SicariusSicariiStuff
Params3.82B
Context128K
Smallest2.2 GB
GGUF

Keep browsing