Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k instruct Q8 0
Phi · lopezhansel
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3.5 mini TitanFusion V2 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · Maites
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 2
Phi · CHJoe
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 4 Q4 0
Phi · RCorvalan
Params14.7B
Context16K
Smallest8.4 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · CodeIsAbstract
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
phi 4 Q4 K M
Phi · ijh4268
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi4 Mini Classifier Merged
Phi · anileo1
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
Phi 3 mini 4k instruct f16
Phi · aschaler
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Habibur2
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · AllStarSupes
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
unsloth_phi3-8bit
Phi · anil1002
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi medprob social n preventive medicine i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 1 Q3 K M
Phi · Merhabalad
Params1.42B
Context2K
Smallest0.7 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · paultimothymooney
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 mini UNOFFICAL Q6 K
Phi · Xiaojian9992024
Params3.75B
Context16K
Smallest3.1 GB
GGUF
PH
phi 4
Phi · kaimi1616
Params14.7B
Context16K
Smallest29.3 GB
GGUF
PH
phi 3.5 mini instruct finetuned
Phi · Eager-st87
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 4 Q4 K M
Phi · straino
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi-3-mini-4k-instruct_q4_k_m_gguf
Phi · datnguyen-dbs
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q8 0
Phi · aminkhalafi
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k instruct v2
Phi · rockstarcruzin
Params3.82B
Context4K
Smallest2.7 GB
GGUF
PH
Phi 3.5 mini instruct hfc
Phi · Neuranest
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Visa Phi 3
Phi · N190028
Params14B
Context4K
Smallest14.8 GB
GGUF
PH
DeepThink Phi4 gguf all
Phi · EpistemeAI
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
V2Phi 3 Mini 4k Instruct Inscripciones Bnb 4bit GGUF
Phi · BernalHR
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 ColdBrew 14B Test0
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · Iambackup
Params14B
Context4K
Smallest11.5 GB
Coding

Keep browsing