Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 2 Electrical Engineering
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 3 Mini 4k Instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
dolphin 2.9.2 Phi 3 Medium i1
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
PH
cognitivecomputations Dolphin 2.9.1 Phi 3 Kensho 4.5B GGUF smashed
Phi · PrunaAI
Params6.54B
Context4K
Q4_K_M4.0 GB
PH
Phi 3.5 Mini Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Heliars Phi4 Carla X1 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
TextSynth Phi4 14B GGUF
Phi · theprint
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 2 OBLITERATED
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Igbo Phi3 Bilingual Chat v1 Merged
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 4 Reasoning Plus
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 4 Mini Reasoning Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 3 portuguese tom cat 4k instruct
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 2 Insurance_Qa Sft Lora
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
jasonhwan phi3 redteamer
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
fractalego wafl phi3 mini 4k
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · DevQuasar-9
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 4 Bifrost Sol 3.8B
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
akshit Gupta phi3 sharegpt fullnew merged FinetunedByAG
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
PH
phi 4 imatrix
Phi · duyntnet
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
sqft phi 3 mini 4k 50 base i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 2 imatrix
Phi · duyntnet
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 400 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 2 LogiCoT finetuned
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
phi 2 chat turkish
Phi · afrideva
Params2.78B
Context2K
Q4_K_M1.8 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB