Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 2 Electrical Engineering
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
dolphin 2.9.2 Phi 3 Medium i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
PH
cognitivecomputations Dolphin 2.9.1 Phi 3 Kensho 4.5B GGUF smashed
Phi · PrunaAI
Params6.54B
Context4K
Q4_K_M4.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Heliars Phi4 Carla X1 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
TextSynth Phi4 14B GGUF
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 OBLITERATED
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Igbo Phi3 Bilingual Chat v1 Merged
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
PH
Phi 4 Mini Reasoning Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoningTool use
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 3 portuguese tom cat 4k instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 2 Insurance_Qa Sft Lora
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
jasonhwan phi3 redteamer
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
fractalego wafl phi3 mini 4k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · DevQuasar-9
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
PH
akshit Gupta phi3 sharegpt fullnew merged FinetunedByAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi 4 imatrix
Phi · duyntnet
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
sqft phi 3 mini 4k 50 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
phi 2 imatrix
Phi · duyntnet
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 400 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 2 LogiCoT finetuned
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
phi 2 chat turkish
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF

Keep browsing