Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 GGUF imatrix
Phi · mcm07
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
Phi 4 R1 Medical3
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning
PH
Phi 3 medium 4k instruct Q4 K M
Phi · fernandoruiz
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi4 Codestandard
Phi · zakie0161
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Edge-Quant
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi medprob pathology i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 128k instruct GPT4Choice 4.6k DPO IQ4 NL
Phi · cleatherbury
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 4 14b It R1 M22K_Lora
Phi · c00cjz00
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
Phi 4 Mini Instruct
Phi · BernTheCreator
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
Kanoonu AI Phi3
Phi · tejasgowda05
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi3Unlocked
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
GGUF
PH
repo
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · itlwas
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi35 3B 1B CLM
Phi · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · meetara-lab
Params3.82B
Context128K
Q4_K_M2.4 GB
ReasoningTool use
PH
Phi 3 medium 128k instruct Q4 K M
Phi · ssmits
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · springwater
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 medium 4k instruct Q4 K M
Phi · sdrshn-nmbr
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · freakyXO
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · flyfishstudio
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi3 avro gguf q4km
Phi · oriolrius
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi35 sap ax instruct
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi4 actualplay
Phi · elaverick
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
contactextraction_zsj_phi3-bnb-4bit_finetuned_0.0.3
Phi · ashokpoudel
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q4 K M
Phi · dean2155
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
phi 4 Q4 0
Phi · msyukorai
Params14.7B
Context16K
Smallest8.3 GB
Coding
PH
phi 4 Q3 K S
Phi · RCorvalan
Params14.7B
Context16K
Smallest6.5 GB
Coding
PH
Phi3 Legal Finetuned
Phi · sairamn
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 3.5 moe q8 0 cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Smallest44.5 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · Testasfsd
Params3.82B
Context128K
Smallest4.1 GB
Coding

Keep browsing