Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
RAG 12000 Phi 4 GGUF
Phi · R0bfried
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
model006 dogruAI q4 k m
Phi · dogruaitech
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
WAIDWML Phi4 8x14B Bf16
Phi · mradermacher
Params91.7B
Context16K
Smallest34.1 GB
GGUF
PH
tough
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
new test 20250801 004113
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 4 Mini Instruct
Phi · aathaval
Params3.84B
Context128K
Smallest3.2 GB
CodingTool use
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled6
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
African Phi3 Finetuned Recipe Chatbot
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · DravenBlack
Params3.84B
Context128K
Smallest2.8 GB
CodingTool use
PH
unsloth phi3 4bit
Phi · anil1002
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
ExpertiaPhysics Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3 medium 4k instruct Q4 K M
Phi · aayushg159
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi medner consult historyandphy
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Medical Gguf Turkish
Phi · falan42
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
Phi 3 mini 128k instruct GPT4Choice 4.6k DPO Q5 K M
Phi · cleatherbury
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
LocalAI functioncall phi 4 v0.1 Q4 K M
Phi · LocalAI-io
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Medical
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
magnifi Phi3 intent v47 4 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Edge-Quant
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
joke finetome model gguf phi4 20260106 111207
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3 nl sql
Phi · whoami02
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · gabrielmachado
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · AlSamCur123
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi4 15 epoch
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
spin phi2
Phi · wambugu71
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Medium 4k Instruct Bnb 4bit
Phi · hemanth1437
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Recipe phi4
Phi · AlterEgo09
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mitulagr2
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
therapy
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi mts dialogue clinical note MEDICATIONS
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing