Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
test
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi3.5 hallucination judge merge
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · mackkkkkilllll
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
phi 2 orange v2
Phi · mlabonne
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · jacobcarajo
Params3.82B
Context128K
Smallest2.8 GB
Coding
PH
phi4 reasoner v1
Phi · ness15
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Luna v3
Phi · cosmosai471
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · AdnanRiaz107
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 128k instruct Q5 0
Phi · AbhishekVenkatachalam06
Params3.82B
Context128K
Smallest2.6 GB
Coding
PH
Phi 4 ReasoningRP Q8 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
phi 4 Q4 K M
Phi · dataplayer12
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Tarot Reading Model
Phi · Ikkyuuu
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · alal123
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
Phi 3 mini 128k instruct Q4 K M
Phi · sth4nth
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · pythonplayer123
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
phi 2
Phi · fong33
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi2 webglm
Phi · praveeny
Params2.78B
Context2K
Smallest2.0 GB
GGUF
PH
Phi 3 mini 128k instruct Q8 0
Phi · vinhnx90
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 3 mini 4k instruct IQ4 NL imat
Phi · SixOpen
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi3 medium 128k instruct
Phi · aisuko
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · redhat6
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
voilent content detection phi3.5 mini
Phi · PyPranav
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 mini 4k instruct Q3 K M
Phi · yh-yao
Params3.82B
Context4K
Smallest2.0 GB
Coding
PH
phi 4 Q8 0
Phi · NikolayKozloff
Params14.7B
Context16K
Smallest15.6 GB
Coding
PH
phi4 finetune finetome 20260210 052937 best trainloss step00900 gguf q4 k m
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
slim extract phi 3
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
phi 4 Q4 K M
Phi · datouge
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
PH
Phi 4 Mini Instruct
Phi · RCorvalan
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Phi 3 Mini 4k Instruct
Phi · divkovic
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
WizardLM Phi 3.5
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF

Keep browsing