Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Finance Phi3 Gguf Local
Phi · Wellwisher12
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
patched phi 3.5
Phi · patched-codes
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Mini Reasoning
Phi · Riza135132
Params3.84B
Context128K
Smallest2.8 GB
PH
phi 3 mini reason IQ4 NL
Phi · gate369
Params3.82B
Context128K
Smallest2.2 GB
PH
phi 4 MP
Phi · steampunque
Params14.7B
Context16K
Smallest8.6 GB
PH
phi 3 md
Phi · hackint0sh
Params3.82B
Context128K
Smallest4.1 GB
PH
Nemo Instruct 2407 MPOA v2 12B
Phi · phi0112358
Params12.2B
Context128K
Q4_K_M7.5 GB
PH
KimLan phi 2 zh
Phi · elliotthwangmsa
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 3.5 Mini Instruct
Phi · blogcncom
Params3.82B
Context128K
Smallest2.2 GB
PH
test model
Phi · KhaptIA
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
sqft phi 3 mini 4k 40 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi_4_14b_finetuned_pattern_classification_gguf
Phi · KS112
Params14.7B
Context16K
Smallest10.4 GB
PH
phi 4 Q4 K M
Phi · Akshay1996
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Obelix Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi medquad causes
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
op phi 1.5
Phi · operator-technology
Params1.41B
Context—
Smallest0.8 GB
PH
phi 2 instruct
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
PH
kosmox-tiny-gguf
Phi · wop
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · Nabokov
Params3.82B
Context128K
Smallest2.6 GB
PH
Phi 3.5 Mini Instruct
Phi · freakyXO
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · Stark2008
Params14B
Context4K
Smallest6.9 GB
PH
Phi 3 Medium 128k Instruct
Phi · matrixportalx
Params14B
Context128K
Q4_K_M8.6 GB
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest6.1 GB
PH
Patent
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
phi4 grpo lora s1000
Phi · tingting
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Abliterated
Phi · Lucy-in-the-Sky
Params14.7B
Context16K
Smallest5.5 GB
PH
Phi 4 Genaiscript Q4_K_M
Phi · igor273
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
PH
threadyLLM 3b 128k
Phi · awels
Params3.82B
Context128K
Smallest7.6 GB