Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 14B REASONING 2000Steps q4 k m
Phi · GregKara
Params14.7B
Context16K
Q4_K_M8.9 GB
Reasoning
PH
MoxoffSrL Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi medquad examsandtests i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi4 RMath 14B
Phi · tejzpr
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Ukr Synth Phi 3.5
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · kaushiksiva07
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 2 thermostat
Phi · ThoughtfulThings
Params2.78B
Context2K
Smallest3.0 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 0
Phi · tushar310
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 4 Trim Exp1
Phi · mradermacher
Params7.5B
Context16K
Q4_K_M4.6 GB
GGUF
PH
joke finetome model gguf phi4 20260108 044416
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct f16
Phi · rhaymison
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Base Phi 3.5
Phi · NandaArya
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 mini instruct guanaco
Phi · aifinitydigital
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 2 Layla v1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medmcqa question generation anatomy lora Q8 0
Phi · farikaw599
Params2.78B
Context2K
Smallest0.1 GB
GGUF
PH
orca_mini_v9_2_14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Ma921 Phi 2 Sft Golden Hh
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
phi 4 feeling
Phi · leonvanbokhorst
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Moxoff Phi3Mini PPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Tiny Random Phi3ForCausalLM
Phi · mradermacher
Params2M
Context4K
Q4_K_M0.0 GB
GGUF
PH
GGUF Therapy Set
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
ontocord phi 3 22b 128k
Phi · RichardErkhov
Params22.1B
Context128K
Q4_K_M13.6 GB
GGUF
PH
phi 2 Q8 0
Phi · wahidmounir
Params2.78B
Context2K
Smallest3.0 GB
Coding
PH
Phi 4 Mini Exp 1102
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Hercules Phi 2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2 DLEC
Phi · mradermacher
Params3.25B
Context2K
Q4_K_M2.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · paultimothymooney
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Jackterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo1epoch v3
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing