Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Finance Phi3 Gguf Local
Phi · Wellwisher12
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
patched phi 3.5
Phi · patched-codes
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · Riza135132
Params3.84B
Context128K
Smallest2.8 GB
CodingReasoningTool use
PH
phi 3 mini reason IQ4 NL
Phi · gate369
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi 4 MP
Phi · steampunque
Params14.7B
Context16K
Smallest8.6 GB
GGUF
PH
phi 3 md
Phi · hackint0sh
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Nemo Instruct 2407 MPOA v2 12B
Phi · phi0112358
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
PH
KimLan phi 2 zh
Phi · elliotthwangmsa
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · blogcncom
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
test model
Phi · KhaptIA
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
sqft phi 3 mini 4k 40 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi_4_14b_finetuned_pattern_classification_gguf
Phi · KS112
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
phi 4 Q4 K M
Phi · Akshay1996
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Obelix Phi2
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medquad causes
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
op phi 1.5
Phi · operator-technology
Params1.41B
Context—
Smallest0.8 GB
GGUF
PH
phi 2 instruct
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PH
kosmox-tiny-gguf
Phi · wop
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Nabokov
Params3.82B
Context128K
Smallest2.6 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · freakyXO
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi 3 Medium 4k Instruct Abliterated v3
Phi · Stark2008
Params14B
Context4K
Smallest6.9 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · matrixportalx
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest6.1 GB
Coding
PH
Patent
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi4 grpo lora s1000
Phi · tingting
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Abliterated
Phi · Lucy-in-the-Sky
Params14.7B
Context16K
Smallest5.5 GB
GGUF
PH
Phi 4 Genaiscript Q4_K_M
Phi · igor273
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest11.5 GB
GGUF
PH
threadyLLM 3b 128k
Phi · awels
Params3.82B
Context128K
Smallest7.6 GB
GGUF

Keep browsing