Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi3 drone model 2nd
Phi · manhvuvan
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3 medmcqa finetuned Q4 K M
Phi · lin789
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Genaiscript
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
PH
PakistaniLawPhi 3
Phi · KHAN8816
Params9M
Context—
Smallest0.0 GB
GGUF
PH
Phi 3 3.8b unsloth merged
Phi · sonu2023
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi-3-Large-5.6b
Phi · NikolayKozloff
Params5.63B
Context4K
Smallest6.0 GB
GGUF
PH
Phi 3 mini 4k instruct Q2 K
Phi · taehunkang301
Params3.82B
Context4K
Smallest1.4 GB
Coding
PH
phi3_finetuned
Phi · madushan99
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Demo Phi3 instructionMachine 16bit
Phi · Peerapol
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
phi35 cn 4k 8Sep
Phi · yongsen-teo
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3.5 Mini Sonet RP V2 Q5 K M
Phi · bunnycore
Params3.82B
Context128K
Smallest2.8 GB
Roleplay
PH
Calme 2.1 Phi3 4b
Phi · Nabokov
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · newsletter
Params14B
Context128K
Smallest14.8 GB
Coding
PH
Phi 4 ColdBrew 14B Test3
Phi · Theros
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
MedBot Phi 3 mini
Phi · Nitishsharma9
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
phi3 finetuned amila009 reaxys type 2
Phi · amila009
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi4 mini q8 0
Phi · kvignesh
Params3.84B
Context128K
Smallest4.1 GB
Tool use
PH
Phi-3-medium-4k-instruct
Phi · weiiv
Params14B
Context4K
Smallest14.8 GB
GGUF
PH
Phi 4 Abliterated
Phi · System5
Params14.7B
Context16K
Smallest8.4 GB
GGUF
PH
race llm phi4 Q5 K M
Phi · nibauman
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
phi 4
Phi · yasserrmd
Params14.7B
Context16K
Smallest5.6 GB
GGUF
PH
Phi 3.5 mini TitanFusion 0.6 IQ4 NL
Phi · bunnycore
Params3.82B
Context128K
Smallest2.2 GB
GGUF
PH
magnifi Phi3 intent v48 1 w unknown 7 lr 0.002
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Empathetic
Phi · Otakadelic
Params14.7B
Context16K
Smallest12.0 GB
GGUF
PH
Phi 3 mini ft arxiv math Q8 0
Phi · agkavin
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
ExpertiaChemistry Q4
Phi · OscarFeMa
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 4 Unsloth Bnb 4bit Elife Lora Q5 K M
Phi · Szahriwar
Params14.7B
Context16K
Smallest10.4 GB
GGUF
PH
multiple Phi3
Phi · Peerapol
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · richsnow
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
Model Phi 3.5
Phi · Swissmountain
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing