Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi4 r1
Phi · ericnunes1
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 3 Mini 4k Instruct
Phi · zaptrixio
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi mts dialogue clinical note genhx lora Q8 0
Phi · introvoyz041
Params24M
Context—
Smallest0.0 GB
GGUF
PH
phi 2
Phi · reach-vb
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · akshaykdeo
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi 2 finetuned med text
Phi · fcn94
Params2.78B
Context—
Smallest1.6 GB
GGUF
PH
phi 3 mini 128k instruct ru
Phi · BoscoTheDog
Params3.82B
Context128K
Smallest1.7 GB
Coding
PH
martinLLM Phi 4b 128k
Phi · fbeawels
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
phi 4 Q6 K
Phi · dataplayer12
Params14.7B
Context16K
Smallest12.0 GB
GGUF
PH
magnifi Phi3 intent v45 3 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi4-Finetuned
Phi · Ashishdalmia
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi35 sap ax migration v2
Phi · Bhuvanesh0195
Params3.82B
Context128K
Smallest3.1 GB
Coding
PH
Phi 4 Mini Instruct
Phi · viniciusianni
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
phi 2 ko v0.1
Phi · changok
Params2.86B
Context2K
Smallest1.3 GB
GGUF
PH
Phi medquad causes i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 trained with file
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
phi3 orpo Q4 K M
Phi · justinj92
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi4 trained with func ep1
Phi · Kei5uke
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
joke finetome model gguf phi4 20260107 021924
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K M
Phi · janw23
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
phi3.5 finetuned final
Phi · KamalM12
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini v2024.07 4K Instruct
Phi · mukel
Params3.82B
Context4K
Smallest2.2 GB
GGUF
PH
Phi 2 Finetuned Qa Medmcqa
Phi · farikaw599
Params26M
Context—
Smallest0.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Srikant86
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 3 mini 128k instruct mix spider bird 1 epoch Q4 K M
Phi · paulo037
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
MoxoffSrL Moxoff Phi3Mini DPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · BhuvanaJanita
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 128k instruct Q8 0
Phi · jamesburton
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · acrkaan
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF

Keep browsing