Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 mini 4k instruct Q4 0
Phi · kaushiksiva07
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
Phi medmcqa question generation gynaecology n obstetrics lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi3.5 phunction calling
Phi · ayan-sh003
Params3.82B
Context128K
Smallest2.7 GB
Tool use
PH
phi4 magpie reasoning v4
Phi · bveiseh
Params14.7B
Context16K
Smallest15.6 GB
Reasoning
PH
Phi 3 medium 128k instruct Q3 K L
Phi · CHE-72
Params14B
Context128K
Smallest7.5 GB
Coding
PH
phi-3-mini-4k-emotional-support-gguf
Phi · arg0x
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · tensorblock
Params14B
Context128K
Smallest5.1 GB
GGUF
PH
joke finetome model gguf phi4 20260110 090947
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi mts dialogue clinical note ALLERGY
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 mini instruct
Phi · ss-lab
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 3.1 abliterated
Phi · ndavidson
Params3.82B
Context4K
Smallest2.2 GB
Coding
PH
phi 3.1 medium
Phi · afg1
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
PH
phi 4 Q4 0
Phi · roleplaiapp
Params14.7B
Context16K
Smallest8.4 GB
Coding
PH
phi 2 Q4 K M
Phi · de3d3ddx
Params2.78B
Context2K
Q4_K_M1.7 GB
Coding
PH
cream phi 2 v0.1
Phi · BeaverLegacy
Params2.78B
Context2K
Smallest3.0 GB
Coding
PH
Phi medmcqa question generation biochemistry lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Hypertension fusion phi 1.5
Phi · mradermacher
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PH
ExplainIt Phi
Phi · simraann
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi 3.5 k8s troubleshoot phi
Phi · Umesh1212
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 medium 4k instruct
Phi · AI-Engine
Params14B
Context4K
Smallest10.1 GB
GGUF
PH
KimLanpure phi 3 zh
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi3 rag relevance judge merge
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
richie ghost phi 3 5 FT guanaco
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi4_30_Epoch
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Finance Cre Finetuned
Phi · pramod-thaz
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 14B grpo limo q4
Phi · mrm8488
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
COSMOS 3B
Phi · MoonieJeon
Params3.82B
Context4K
Smallest2.4 GB
GGUF
PH
joke finetome model gguf phi4 20260111 061344
Phi · Mathieu-Thomas-JOSSET
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
slim qa gen phi 3 tool
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
Tool use
PH
phi 3 mini 4k instruct gguf finetuned3
Phi · spiritbear22
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF

Keep browsing