Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
AEGIS Phi3.5mini jp v2.4
Phi · zapabobouj
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Neural phi2
Phi · charioteer
Params2.78B
Context2K
Smallest1.6 GB
GGUF
PH
GGUF VERI
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
medical embryology
Phi · ambrosfitz
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Solvrays
Phi · singtan
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
MicroAtlas V1 F16
Phi · turtle170
Params3M
Context—
Smallest0.0 GB
GGUF
PH
Phi 3 mini 4k instruct IQ4 NL
Phi · MugenYume
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi medprob physiology
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Smallest2.1 GB
Tool use
PH
phi 4 abliterated Orion 18B Q8 0
Phi · Otakadelic
Params18.1B
Context16K
Smallest19.2 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · jacobcarajo
Params14.7B
Context32K
Smallest10.6 GB
CodingReasoning
PH
Phi
Phi · Anshuman9600000
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · jelawless
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
phi3-mini-4k-gguf
Phi · ALI-B
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
aigf-phi3-mini-v2
Phi · pranav79
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 128k instruct Q8 0
Phi · CHE-72
Params14B
Context128K
Smallest14.8 GB
Coding
PH
phi 4 Q2 K
Phi · lin789
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
Phi 4 Megatron Empathetic Q4 K M
Phi · Xiaojian9992024
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
abhiramivs phi 2 medquad
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Mini Flash Telecom Campaign
Phi · azizshaw
Params3.84B
Context128K
Smallest7.7 GB
Tool use
PH
Phi 4 Mini Reasoning Abliterated
Phi · FORNAX20
Params3.84B
Context128K
Smallest4.1 GB
CodingReasoningTool use
PH
Phi 3 mini 4k instruct Q4 K M
Phi · leungchunghong
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · suraiy
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
phi3-lobbying-gguf-q4v2
Phi · twright8
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q2 K
Phi · leolu-1015
Params14.7B
Context16K
Smallest5.5 GB
Coding
PH
Phi 4 Mini Instruct
Phi · jelawless
Params3.84B
Context128K
Smallest2.3 GB
CodingTool use
PH
Phi 3.5 Mini Instruct MedicalChat QLoRA
Phi · jjrhp
Params13M
Context—
Smallest0.1 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · toktomo
Params14B
Context4K
Smallest14.8 GB
Coding
PH
phi 4 test
Phi · kokitakeishi
Params14.7B
Context16K
Smallest4.9 GB
GGUF
PH
phi3_ft
Phi · iach
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing