Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 4k instruct Q4 K S
Phi · fernandoruiz
Params14B
Context4K
Smallest8.0 GB
Coding
PH
Phi 4 Mini Instruct
Phi · StevenMD
Params3.84B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 MoE Instruct
Phi · AbteeXAILab
Params41.9B
Context128K
Q4_K_M25.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · aifeifei798
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · wefstratis-nv
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
PII Model Phi3 Mini Q5 K S
Phi · Aim9099
Params3.82B
Context4K
Smallest2.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · CHE-72
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k instruct Q4 K M
Phi · notjjustnumbers
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
GGUF AMOD
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · lokinfey
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · devisri050
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · AI-Engine
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · nautilie7
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
LinearModel
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
sentiment
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Iris Phi 3 5 mini
Phi · The-regressors
Params3.82B
Context128K
Smallest4.1 GB
Tool use
PH
Phi 4 Mini Reasoning Heretic
Phi · loolzrulez
Params3.84B
Context128K
Smallest2.8 GB
CodingReasoning
PH
phi 3 on mac Q3 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.0 GB
GGUF
PH
Iceball Phi 3.5 mini instruct shareGPT
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi4 Phishing Url Detector
Phi · developermate
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Finance Phi3 Gguf Local
Phi · brodatech
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi4 finetune finetome 20260211 100630 best trainloss step03900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 128k instruct Q5 K S
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.6 GB
Coding
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · Aptronym
Params3.82B
Context128K
Smallest2.8 GB
GGUF
PH
Phi mts dialogue clinical note ALLERGY i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 2
Phi · Askahoward
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 4k instruct Q4 K M
Phi · joshnader
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi4 finetune finetome 20260210 111305 best trainloss step01800 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 2
Phi · InfinityLai
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
slim sa ner phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF

Keep browsing