Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi4 3 epoch
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct Sq
Phi · NikolayKozloff
Params30M
Context—
Smallest0.1 GB
GGUF
PH
Phi 4 ColdBrew 14B Intrepid Test1
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
das
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 4 poc
Phi · kygbjs
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
SauerkrautLM-Phi-3-medium
Phi · NikolayKozloff
Params14B
Context4K
Smallest9.9 GB
GGUF
PH
phi3 uncensored chat
Phi · ZeroWw
Params3.82B
Context4K
Smallest2.5 GB
GGUF
PH
phi 1 Q4 K M
Phi · Mayank-sharma108
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
PH
Phi3-16bit_GGUF
Phi · HaitameLaframe
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 128k instruct Q4 K M
Phi · GeorgeBredis
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
HOTfinetunedSample
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
joke finetome model gguf phi4 20260106 235111
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3 mini 4k qlora jmultiwoz dolly amenokaku alpaca jp python
Phi · taoki
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
k8s phi3.5 train trobleshoot
Phi · subodh624
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · itlwas
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
Phi 3 mini 4k instruct
Phi · OllmOne
Params3.82B
Context4K
Smallest2.3 GB
GGUF
PH
dataseturl
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · iamahmadsaboor
Params3.84B
Context128K
Smallest2.3 GB
CodingReasoningTool use
PH
Phi 3 mini 128k instruct Q8 0
Phi · Trisert
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
fullsendbaby
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi3 Mini Distributed Fine Tune
Phi · 4iqq
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
magnifi Phi3 intent v32 3 epoch 9 lr 0.002 r 16 a 8
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · murean
Params3.84B
Context128K
Smallest2.8 GB
CodingTool use
PH
Phi 3 medium 128k instruct Q4 K S
Phi · NikolayKozloff
Params14B
Context128K
Smallest8.0 GB
Coding
PH
Cream Phi 3 14B v1
Phi · BeaverLegacy
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
Phi4 TrSummarization unsloth
Phi · anilguven
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Iceball Phi 3.5 mini instruct v1
Phi · EpistemeAI2
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · wambugu71
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
juanid-phi3-instruct-finetuned-2-GGUF
Phi · junaidiqbalsyed
Params3.82B
Context4K
Smallest7.6 GB
GGUF

Keep browsing