Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
unsloth Phi 3 medium 4k instruct 32 2 0.0005 16
Phi · dmntrd
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
PH
Phi medmcqa question generation biochemistry lora Q8 0
Phi · introvoyz041
Params24M
Context—
Smallest0.0 GB
GGUF
PH
phi4 finetune finetome 20260210 052937 best evalloss step00950 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
shashank23088 phi 2 snli
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Medical Phi2
Phi · Prithwiraj731
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 reasoning plus ablit
Phi · peelsa
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
magnifi Phi3 intent v46 1 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3.5 sakura yuzu v2 Q8 0
Phi · win10
Params4.84B
Context4K
Smallest5.1 GB
GGUF
PH
Phi4 RP O1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
Phi medprob medicine
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Genuine Phi4
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi2 mini
Phi · calcuis
Params2.78B
Context2K
Smallest1.5 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · StevenMD
Params3.84B
Context128K
Smallest4.1 GB
GGUF
PH
phi3 5 doctor segc
Phi · segestic
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · TerraNTR
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi3 mini json extractor
Phi · sltanu
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Mourshid Goal Decomposer
Phi · Mourshid
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
phi3_meeting_model2
Phi · udayakumar-cyb
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · nickk256
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi2 lora finetuned
Phi · hridyansh22
Params2.78B
Context2K
Smallest1.2 GB
GGUF
PH
phi3 5 gsm8k LORA
Phi · zeref713
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Rates
Phi · dianak12
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
model phi3 5 mini instruct
Phi · axelblenna
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
PHI3
Phi · ALI-B
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct plan NL finetuned
Phi · XWidener
Params3.82B
Context4K
Smallest0.6 GB
GGUF
PH
phi 2 Q4 K M
Phi · marroyo777
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
Phi Line_14B
Phi · SicariusSicariiStuff
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PH
Colab_Phi3
Phi · muhammadhuzaifano1
Params8.03B
Context128K
Smallest16.1 GB
Tool use
PH
Phi 4 Reasoning Plus
Phi · IWasBorn3D
Params14.7B
Context32K
Smallest15.6 GB
CodingReasoning
PH
Vitas Ayurveda Phi3
Phi · Shubh769
Params3.82B
Context4K
Smallest2.3 GB
GGUF

Keep browsing