Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi3-lobbying-gguf
Phi · twright8
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · arifsw
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
magnifi Phi3 intent v44 1 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi-3-mini-4k-instruct_q5_k_m_gguf
Phi · datnguyen-dbs
Params3.82B
Context4K
Smallest2.7 GB
GGUF
PH
Phi 4 Reasoning
Phi · mmnga
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
ExpertiaSWE Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
juanid-phi3-instruct-finetuned-GGUF
Phi · junaidiqbalsyed
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
Phi 3 Mini 128k Instruct
Phi · Lucy-in-the-Sky
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 Mini Instruct
Phi · bchen-snp
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 4 Q8 0
Phi · paramedik
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
Phi4 func explain
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K S
Phi · mrmage
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi_3_math_fine_tuned_gguf
Phi · Ebullioscopic
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3mini conversational drone
Phi · manhvuvan
Params3.82B
Context128K
Q4_K_M2.3 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · matheusUema
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
scm_phi3_q4_k_m
Phi · sebdg
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3.5 sakura yuzu v2.5 Q8 0
Phi · win10
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Oneshot
Phi · dianak12
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
meha_html_model_q4_k_m-GGUF
Phi · jawerty
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 mini ITA Q8 0
Phi · lukecage
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · argearriojas
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
MoxoffSrL Moxoff Phi3Mini PPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 medium 128k instruct Q6 K
Phi · ssmits
Params14B
Context128K
Smallest11.5 GB
Coding
PH
Phi 3 medium 128k instruct Q4 K M
Phi · AdvaitTahilyani
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · roleplaiapp
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi medprob anatomy
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · kolosal
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi4 inno handbook2
Phi · aaronnat23
Params14.7B
Context16K
Smallest15.6 GB
GGUF

Keep browsing