Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
tf phi3.5 q5
Phi · TheHost
Params3.82B
Context128K
Smallest2.7 GB
GGUF
PH
win10 phi3.5 mini 24 09 30
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medquad examsandtests
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
bling phi 3.5
Phi · llmware
Params3.82B
Context128K
Smallest2.4 GB
GGUF
PH
gautamritvik/Curl-Bot
Phi · gautamritvik
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k instruct Q4 K M
Phi · Akshay1996
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 Trim RP
Phi · mradermacher
Params6.48B
Context16K
Q4_K_M4.0 GB
Roleplay
PH
Phi 4 Mini Reasoning
Phi · iamahmadsaboor
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi4 8b Unsloth GGUF
Phi · MrMike42
Params14.7B
Context32K
Q4_K_M8.9 GB
GGUF
PH
phi3minimodel
Phi · Striker-7
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · goodasdgood
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi3 lora ktomixen post sft mathinstruct lima partial
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4 Pdf Merged
Phi · Darius-Maximus
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
dj-phi-3-F16-GGUF
Phi · deepanshdj
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 medium 4k instruct ko poc gguf v0.1
Phi · daekeun-ml
Params14B
Context4K
Smallest8.8 GB
GGUF
PH
phi3.5 bio pt
Phi · matheusfvesco
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
model 16bitgguf phi3.5 movie
Phi · meghana-choudhary
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Astralyra
Params3.84B
Context128K
Smallest3.2 GB
CodingTool use
PH
phi 4
Phi · kolosal
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi2 medical
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
II Search CIR 4B
Phi · phi0112358
Params4.02B
Context40K
Smallest4.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 0
Phi · Earthkwake
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi3-MB_16b
Phi · SSepiol
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
joke finetome model gguf phi4 20260106 220520
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K M
Phi · cleatherbury
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
WizardLM Phi 3.5gguf
Phi · karasu000
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Medical Phi 3.5 Mini Instruct
Phi · loholeo
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi4 finetune finetome 20260210 111305 best evalloss step00250 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K M
Phi · farpluto
Params14B
Context4K
Q4_K_M8.6 GB
Coding

Keep browsing