Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Med Bot Phi 3.5 mini
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 128k instruct
Phi · MBASE
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
phi 3 mini 128k instruct mix spider bird 2800 steps Q4 K S
Phi · paulo037
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
Phi3 Coding Adapter
Phi · vvnaren
Params5M
Context—
Smallest0.0 GB
GGUF
PH
magnifi Phi3 intent v47 3 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k FC v1
Phi · rockstarcruzin
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi 3.5 moe cpu offload
Phi · MikeKuykendall
Params41.9B
Context128K
Smallest83.8 GB
GGUF
PH
phi3 5 gsm8k LORA LATEST
Phi · zeref713
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Clinical_Reasoning
Phi · olusegunola
Params3.82B
Context128K
Q4_K_M2.4 GB
Reasoning
PH
Phi 3B OnFrench Instruct Q4 K M
Phi · Maites
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
test continued pretraining Phi 3 mini 4k instruct Unsloth merged 16bit Q8 0
Phi · QuiXilver777
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
opnsense agent phi35
Phi · patlegu
Params3.82B
Context128K
Q4_K_M2.4 GB
Tool use
PH
merv phi4mini
Phi · freeideas
Params3.84B
Context128K
Q4_K_M2.5 GB
RoleplayTool use
PH
Phi 3 mini 4k instruct q4
Phi · papineau1837
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
ella
Phi · RikenSh
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3 mini 4k instruct gguf derived
Phi · zhhan
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · itlwas
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
social media advisor phi2
Phi · Aayush61000
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · psychopenguin
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi 4 Q3 K M
Phi · RCorvalan
Params14.7B
Context16K
Smallest7.4 GB
Coding
PH
phi3-nspFaq
Phi · punit461
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 14 test model 2
Phi · Sgnarf
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi3 Ggf All
Phi · veeru7474
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
ChillTranslator
Phi · lukestanley
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · foxcyan
Params3.82B
Context128K
Smallest2.6 GB
Coding
PH
phi athlete anxiety model
Phi · Mernaaaa
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 2 light
Phi · ThoughtfulThings
Params2.78B
Context2K
Smallest3.0 GB
GGUF
PH
Phi3 Design Patterns Expert
Phi · kerolos123
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3 mini spider sql
Phi · this-is-rickroy
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · sheldonrobinson
Params3.82B
Context128K
Smallest4.1 GB
Coding

Keep browsing