Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
tarpit_cleaner_phi3_q4_k_m
Phi · JunyaoC
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.1 mini 4k instruct Q4 K M gguf chunked
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi medprob surgery
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
phi4 test
Phi · PAUL1122
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi4 func epoch 3
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Reasoning
Phi · Widso
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
PH
Phi 3 Mini OpenHermes Magpie V1 F16
Phi · turtle170
Params3M
Context—
Smallest0.0 GB
GGUF
PH
KimLanpure phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · vladfaust
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
phi3 gsm8k Q8 0
Phi · zeref713
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi3 Mini Rq
Phi · zbxxx
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
twenty one
Phi · ahmadmirza17
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Unsloth Bnb 4bit_gguf
Phi · AndresR2909
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 3 mini 4k instruct latest version July 2024 Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
Coding
PH
phi3 medmcqa finetuned Q8 0
Phi · lin789
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · dkumango
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
Kimlantg Phi 4 Mini Instruct Tw
Phi · elliotthwangmsa
Params3.84B
Context128K
Smallest2.5 GB
Tool use
PH
Phi 4 mini reasoning gguf q4 k m
Phi · keisuke-miyako
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
PH
phi 2.two wheeler dataset finetuned
Phi · STGYO
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · Aptronym
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
phi 4 f16 ollama
Phi · vincentoh
Params14.7B
Context16K
Smallest29.3 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · szaboildi
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi Major Project
Phi · psychopenguin
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Neel Madhav Phi3
Phi · Khush2007
Params3.21B
Context128K
Smallest2.0 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · kalle07
Params3.84B
Context128K
Smallest7.7 GB
Tool use
PH
phi 2 finetuned
Phi · Stypox
Params2.78B
Context2K
Smallest1.6 GB
GGUF
PH
Eggs and Bacon RP Phi 3 Q4 K M
Phi · jeiku
Params3.82B
Context4K
Q4_K_M2.4 GB
Roleplay
PH
portuguese Phi3 Tom Cat 128k instruct Q4 K M
Phi · fernandovmacedo
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi-4-Mini-Reasoning
Phi · Felladrin
Params3.84B
Context128K
Smallest2.5 GB
ReasoningTool use
PH
phi2 bunny Q8 0
Phi · sillykiwi
Params2.78B
Context2K
Smallest3.0 GB
GGUF

Keep browsing