Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 medium 4k instruct Q4 K S
Phi · fernandoruiz
Params14B
Context4K
Smallest8.0 GB
PH
Phi 4 Mini Instruct
Phi · StevenMD
Params3.84B
Context128K
Smallest4.1 GB
PH
Phi 3.5 MoE Instruct
Phi · AbteeXAILab
Params41.9B
Context128K
Q4_K_M25.3 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · aifeifei798
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · wefstratis-nv
Params3.82B
Context128K
Smallest2.2 GB
PH
PII Model Phi3 Mini Q5 K S
Phi · Aim9099
Params3.82B
Context4K
Smallest2.6 GB
PH
Phi 3 mini 128k instruct Q8 0
Phi · CHE-72
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · notjjustnumbers
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
GGUF AMOD
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Reasoning
Phi · lokinfey
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · AI-Engine
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3.5 Mini Instruct
Phi · nautilie7
Params3.82B
Context128K
Smallest4.1 GB
PH
LinearModel
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
sentiment
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Iris Phi 3 5 mini
Phi · The-regressors
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Reasoning Heretic
Phi · loolzrulez
Params3.84B
Context128K
Smallest2.8 GB
PH
phi 3 on mac Q3 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.0 GB
PH
Iceball Phi 3.5 mini instruct shareGPT
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
Phi4 Phishing Url Detector
Phi · developermate
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Finance Phi3 Gguf Local
Phi · brodatech
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
phi4 finetune finetome 20260211 100630 best trainloss step03900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 mini 128k instruct Q5 K S
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.6 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · Aptronym
Params3.82B
Context128K
Smallest2.8 GB
PH
Phi mts dialogue clinical note ALLERGY i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi 2
Phi · Askahoward
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 mini 4k instruct Q4 K M
Phi · joshnader
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi4 finetune finetome 20260210 111305 best trainloss step01800 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 2
Phi · InfinityLai
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
slim sa ner phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB