Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
microsoft Phi 3 mini 128k instruct HQQ 4bit smashed Q4 K M
Phi · suraiy
Params—
Context128K
Q4_K_M0.0 GB
GGUF
PH
Phi medprob surgery i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
bulgarian joke master Phi 3.5 mini
Phi · vislupus
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi35tuned
Phi · Kevinkre
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · huggingkot
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
phi3 text2sql lora
Phi · mrcmilo
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi3.5 Comets 3.8B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 medium 4k instruct 4bit nuclear chat
Phi · inetnuc
Params14B
Context4K
Smallest14.8 GB
GGUF
PH
Xenova Tiny Random Phi3ForCausalLM
Phi · tensorblock
Params2M
Context4K
Smallest0.0 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi3 redteamer
Phi · jasonhwan
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 4 mini UNOFFICAL
Phi · mradermacher
Params3.75B
Context16K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
joke finetome model gguf phi4 20260110 114052
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
Phi 3 Mini 128k Instruct
Phi · llmware
Params3.82B
Context128K
Smallest2.2 GB
Coding
PH
Phi 4 Sce exp v0.1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest7.9 GB
Coding
PH
Microsoft Phi 4 Q8 0
Phi · chjn
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3 mini 4k instruct
Phi · ss-lab
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · YorkieOH10
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 MoE Instruct
Phi · grapevine-AI
Params41.9B
Context128K
Q4_K_M25.3 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · phymbert
Params41.9B
Context128K
Smallest18.1 GB
Coding
PH
Phi 4 Unsloth Bnb 4bit
Phi · IamLazyman
Params14.7B
Context30K
Q4_K_M8.9 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
phi35 sap ax v6
Phi · Bhuvanesh0195
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
Phi 3.5 4B instruct sft
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo2epoch v5
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 mini Q4 K M
Phi · jc-builds
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · giomascardo
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Shiny Phi3.5
Phi · johnsoupir
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing