Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
RAG 12000 Phi 4 GGUF
Phi · R0bfried
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
model006 dogruAI q4 k m
Phi · dogruaitech
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
WAIDWML Phi4 8x14B Bf16
Phi · mradermacher
Params91.7B
Context16K
Smallest34.1 GB
PH
tough
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
new test 20250801 004113
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 4 Mini Instruct
Phi · aathaval
Params3.84B
Context128K
Smallest3.2 GB
PH
Phi 3.5 Mini Instruct SFT D_chosen Dpo Mix Shuffled6
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
African Phi3 Finetuned Recipe Chatbot
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · DravenBlack
Params3.84B
Context128K
Smallest2.8 GB
PH
unsloth phi3 4bit
Phi · anil1002
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
ExpertiaPhysics Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · aayushg159
Params14B
Context4K
Q4_K_M8.6 GB
PH
Phi medner consult historyandphy
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 4 Medical Gguf Turkish
Phi · falan42
Params14.7B
Context16K
Smallest10.4 GB
PH
Phi 3 mini 128k instruct GPT4Choice 4.6k DPO Q5 K M
Phi · cleatherbury
Params3.82B
Context128K
Smallest2.8 GB
PH
LocalAI functioncall phi 4 v0.1 Q4 K M
Phi · LocalAI-io
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Medical
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
magnifi Phi3 intent v47 4 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 4 Mini Instruct
Phi · Edge-Quant
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
joke finetome model gguf phi4 20260106 111207
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi3 nl sql
Phi · whoami02
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · gabrielmachado
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct Bnb 4bit
Phi · AlSamCur123
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi4 15 epoch
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
spin phi2
Phi · wambugu71
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Medium 4k Instruct Bnb 4bit
Phi · hemanth1437
Params14B
Context4K
Q4_K_M8.4 GB
PH
Recipe phi4
Phi · AlterEgo09
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3.5 Mini Instruct
Phi · mitulagr2
Params3.82B
Context128K
Smallest2.8 GB
PH
therapy
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi mts dialogue clinical note MEDICATIONS
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB