Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 Q5 K M
Phi · ProbioticFarmer
Params14.7B
Context16K
Smallest10.6 GB
Coding
PH
prithivMLmods.Phi 4 o1
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
sqft phi 3 mini 4k 60 base
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 MedBot 2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 4 Abliterated
Phi · Iambackup
Params14.7B
Context16K
Smallest12.0 GB
Coding
PH
Phi 3 Medium 4k Instruct
Phi · matrixportalx
Params14B
Context4K
Q4_K_M8.6 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · Lambent
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi medquad frequency i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · Kondara
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Phi3 ITA mini 4K instruct Q4 K M
Phi · e-palmisano
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
localai functioncall phi 4 v0.2 Q4 K M
Phi · LocalAI-io
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
dolphin 2 6 phi 2
Phi · kcoyun
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use
PH
Phi 4 Mini Reasoning Heretic
Phi · loolzrulez
Params3.84B
Context128K
Smallest2.3 GB
CodingReasoning
PH
Phi medmcqa question generation biochemistry lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi4 deepseek r1 distilled gguf v5
Phi · ykarout
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning
PH
phi4 inno handbook1
Phi · aaronnat23
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi medprob dental
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
awelitoLLM phi 4b 128k
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medquad research
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
EXP Phi4 Instruct STM32Lx
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct Annihilated
Phi · Grimxlock
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
phi 1
Phi · professorf
Params1.42B
Context2K
Smallest2.8 GB
Coding
PH
MoxoffSpA Moxoff Phi3Mini DPO
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi medmcqa question generation microbiology lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medmcqa question generation social n preventive medicine lora
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 mini 4k socratic
Phi · Redwyn
Params3.82B
Context4K
Smallest1.2 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · antoste
Params14B
Context128K
Smallest5.1 GB
Coding
PH
SYNERDATA Microsoft Phi 4 14b Q4 0
Phi · SYNERDATA
Params14.7B
Context16K
Smallest8.4 GB
Coding
PH
Tiny Random Phi3ForCausalLM
Phi · mradermacher
Params2M
Context4K
Q4_K_M0.0 GB
GGUF
PH
Phi4
Phi · AlSamCur123
Params14.7B
Context32K
Q4_K_M8.9 GB
GGUF

Keep browsing