Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
convex 2 20250809 233701
Phi · devparagiri
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 song lyrics 1.0
Phi · ZeroWw
Params3.82B
Context4K
Smallest3.1 GB
GGUF
PH
phi 4 Q4 K M
Phi · thoriiiq
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 Mini Reasoning Heretic
Phi · loolzrulez
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoning
PH
Phi 3 mini 128k instruct gguf f16
Phi · eek
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 4k instruct kubefix v0.1
Phi · andyburgin
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · pythonplayer123
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · itlwas
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
fullsendbaby1
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 3.5 moe q4 k m cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Q4_K_M25.3 GB
GGUF
PH
phi35 sap ax v6 2epoch
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · aisuko
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
Phi 3 mini 4k instruct Q8 0
Phi · Nabokov
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
fullrun
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
metamorphy unsloth Phi 3 medium 4k instruct 16 200 0.0001
Phi · dmntrd
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · Riza135132
Params14.7B
Context32K
Smallest8.4 GB
CodingReasoning
PH
CLIENS_PHI4_14B_BF16
Phi · yinghy2018
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3.5 mini instruct func test1 Q8 0
Phi · codito
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RCorvalan
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct IQ4 NL
Phi · aifeifei798
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 4 Q3 K L
Phi · roleplaiapp
Params14.7B
Context16K
Smallest7.9 GB
Coding
PH
phi3 mini 4k qlora mcqa Q8 0
Phi · farikaw599
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
phi 3 mini 128k instruct 04 24
Phi · xaskasdf
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi3 lora sft mathinstruct lima i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medprob microbiology i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
linlearn phi3 linux assistant
Phi · silentone1234
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
ExpertiaMath Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
phi 4 Q4 K M 5GB
Phi · inference-snaps
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi lora 3b medical2
Phi · falan42
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 2 Q4 K M
Phi · raghav0
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding

Keep browsing