Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
GGUF BIOMEDN
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · nguyenbh
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
joke finetome model gguf phi4 20260106 054747
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2
Phi · Monkey
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
ifai promptmkr phi3
Phi · impactframes
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 128k instruct IQ1 S no robots only coding
Phi · willbeez
Params3.82B
Context128K
Smallest0.8 GB
GGUF
PH
phi-3-mental-health-q4
Phi · chillies
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · aminkhalafi
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 4k instruct Q5 K M
Phi · ironlanderl
Params3.82B
Context4K
Smallest2.8 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · garrofe
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 3.5 mini IT ORPO
Phi · iecjsu
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi Lthy4
Phi · mradermacher
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · RCorvalan
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
ender gpt weights
Phi · KingWasHereUC
Params2.78B
Context2K
Smallest5.6 GB
GGUF
PH
Phi 3 medium 128k instruct Q4 K M
Phi · Trisert
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
EMNLP NLLP NLI PHI3 medium withoutSNLI withORPO
Phi · 1-800-SHARED-TASKS
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · sheldonrobinson
Params41.9B
Context128K
Smallest23.6 GB
Coding
PH
Phi 3.5 mini harupfall
Phi · mervinpraison
Params3.82B
Context128K
Q4_K_M2.3 GB
Tool use
PH
Phi 4 Unsloth Bnb 4bit
Phi · PAUL1122
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Alpaca69B phi2 all app reviews absa
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 BABI SFT
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · Vijay109
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · akshaykdeo
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi35 sap ax combined
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · dispatchAI
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · ArribaCampeon
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
phi 4 Q4 0 4 8
Phi · pipilok
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PH
llama3 deepseek Q8
Phi · ykarout
Params8.03B
Context128K
Smallest8.5 GB
CodingReasoningTool use

Keep browsing