Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3 mini 4k instruct Q8 0
Phi · lopezhansel
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3.5 mini TitanFusion V2 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 4 Mini Instruct
Phi · Maites
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 2
Phi · CHJoe
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 4 Q4 0
Phi · RCorvalan
Params14.7B
Context16K
Smallest8.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · CodeIsAbstract
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · Ffftdtd5dtft
Params3.82B
Context128K
Smallest1.4 GB
PH
phi 4 Q4 K M
Phi · ijh4268
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi4 Mini Classifier Merged
Phi · anileo1
Params3.84B
Context128K
Smallest4.1 GB
PH
Phi 3 mini 4k instruct f16
Phi · aschaler
Params3.82B
Context4K
Smallest7.6 GB
PH
Phi 3.5 Mini Instruct
Phi · Habibur2
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3 Mini 4k Instruct
Phi · AllStarSupes
Params3.82B
Context4K
Smallest2.4 GB
PH
unsloth_phi3-8bit
Phi · anil1002
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi medprob social n preventive medicine i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 1 Q3 K M
Phi · Merhabalad
Params1.42B
Context2K
Smallest0.7 GB
PH
Phi 3.5 Mini Instruct
Phi · paultimothymooney
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 mini UNOFFICAL Q6 K
Phi · Xiaojian9992024
Params3.75B
Context16K
Smallest3.1 GB
PH
phi 4
Phi · kaimi1616
Params14.7B
Context16K
Smallest29.3 GB
PH
phi 3.5 mini instruct finetuned
Phi · Eager-st87
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 4 Q4 K M
Phi · straino
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi-3-mini-4k-instruct_q4_k_m_gguf
Phi · datnguyen-dbs
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k instruct Q8 0
Phi · aminkhalafi
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3 mini 4k instruct v2
Phi · rockstarcruzin
Params3.82B
Context4K
Smallest2.7 GB
PH
Phi 3.5 mini instruct hfc
Phi · Neuranest
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Visa Phi 3
Phi · N190028
Params14B
Context4K
Smallest14.8 GB
PH
DeepThink Phi4 gguf all
Phi · EpistemeAI
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
V2Phi 3 Mini 4k Instruct Inscripciones Bnb 4bit GGUF
Phi · BernalHR
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 4 ColdBrew 14B Test0
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · Iambackup
Params14B
Context4K
Smallest11.5 GB