Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
GGUF BIOMEDN
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3.5 Mini Instruct
Phi · nguyenbh
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Reasoning Plus
Phi · NikolayKozloff
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
joke finetome model gguf phi4 20260106 054747
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 2
Phi · Monkey
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
ifai promptmkr phi3
Phi · impactframes
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 mini 128k instruct IQ1 S no robots only coding
Phi · willbeez
Params3.82B
Context128K
Smallest0.8 GB
PH
phi-3-mental-health-q4
Phi · chillies
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · aminkhalafi
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3 mini 4k instruct Q5 K M
Phi · ironlanderl
Params3.82B
Context4K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct
Phi · garrofe
Params3.82B
Context128K
Smallest2.2 GB
PH
Phi 3.5 mini IT ORPO
Phi · iecjsu
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi 3.5 Mini Instruct
Phi · pytholic
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi Lthy4
Phi · mradermacher
Params11.9B
Context16K
Q4_K_M7.3 GB
PH
Phi 4 Mini Instruct
Phi · RCorvalan
Params3.84B
Context128K
Smallest4.1 GB
PH
ender gpt weights
Phi · KingWasHereUC
Params2.78B
Context2K
Smallest5.6 GB
PH
Phi 3 medium 128k instruct Q4 K M
Phi · Trisert
Params14B
Context128K
Q4_K_M8.6 GB
PH
EMNLP NLLP NLI PHI3 medium withoutSNLI withORPO
Phi · 1-800-SHARED-TASKS
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi 3.5 MoE Instruct
Phi · sheldonrobinson
Params41.9B
Context128K
Smallest23.6 GB
PH
Phi 3.5 mini harupfall
Phi · mervinpraison
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 4 Unsloth Bnb 4bit
Phi · PAUL1122
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Alpaca69B phi2 all app reviews absa
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 BABI SFT
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3 Mini 128k Instruct
Phi · Vijay109
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · akshaykdeo
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi35 sap ax combined
Phi · Bhuvanesh0195
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi 3.5 Mini Instruct
Phi · dispatchAI
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi 3.5 Mini Instruct
Phi · ArribaCampeon
Params3.82B
Context128K
Smallest2.2 GB
PH
phi 4 Q4 0 4 8
Phi · pipilok
Params14.7B
Context16K
Smallest8.4 GB
PH
llama3 deepseek Q8
Phi · ykarout
Params8.03B
Context128K
Smallest8.5 GB