Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 128k instruct Q5 K M
Phi · CHE-72
Params14B
Context128K
Smallest10.1 GB
Coding
PH
Phi 3 mini 128k instruct Q3 K L
Phi · islamsaad
Params3.82B
Context128K
Smallest2.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · garrofe
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Abliterated
Phi · ApexReign
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Mayank-sharma108
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 2
Phi · dictatee
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
model phi 3
Phi · axelblenna
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
MotoData Phi2
Phi · Prithwiraj731
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
holodeck phi35
Phi · netwninja82
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 IQ4 XS
Phi · eziyo
Params2.78B
Context2K
Smallest1.5 GB
Coding
PH
Phi 4 RP
Phi · bunnycore
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
PH
phi 4 Q3 K S
Phi · lin789
Params14.7B
Context16K
Smallest6.5 GB
Coding
PH
DuckyBlender racist phi3
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
magnifi Phi3 intent v43 2 w unknown 8 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
contactextraction_zsj_tlm-bnb-4bit_gguf_0.0.13
Phi · ashokpoudel
Params3.82B
Context5K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 mini UNOFFICAL Q5 0
Phi · Xiaojian9992024
Params3.75B
Context16K
Smallest2.7 GB
GGUF
PH
ihughes15234 phi35 kp dpo2epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi3 unsloth resumebot
Phi · aryarishit
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Grace-Zhang48
Params3.84B
Context128K
Smallest1.7 GB
CodingTool use
PH
portuguese Phi3 Tom Cat 128k instruct Q5 K M
Phi · noxinc
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3 Mini 4k Instruct Inscripciones Bnb 4bit GGUF
Phi · BernalHR
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · AI-Engine
Params14B
Context128K
Smallest10.1 GB
GGUF
PH
CN daily convo phi3.5 mini 3Sep
Phi · yongsen-teo
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Responses Testing
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Responses Testing2
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
ExpertiaElectronics Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3 mini 4k instruct ANNIE
Phi · Hongrulee
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
GGUF AMODFull
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · lokinfey
Params3.84B
Context128K
Smallest2.5 GB
Tool use
PH
phi3 mini 4k instruct pii redactor q4 k m
Phi · christopherheuer
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing