Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
tarpit_cleaner_phi3_q4_k_m
Phi · JunyaoC
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.1 mini 4k instruct Q4 K M gguf chunked
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Phi medprob surgery
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
phi4 test
Phi · PAUL1122
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi4 func epoch 3
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Reasoning
Phi · Widso
Params14.7B
Context32K
Q4_K_M9.1 GB
PH
Phi 3 Mini OpenHermes Magpie V1 F16
Phi · turtle170
Params3M
Context—
Smallest0.0 GB
PH
KimLanpure phi 2 zh
Phi · elliotthwang
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 Mini 4k Instruct
Phi · vladfaust
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi3 gsm8k Q8 0
Phi · zeref713
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi3 Mini Rq
Phi · zbxxx
Params3.82B
Context128K
Smallest7.6 GB
PH
twenty one
Phi · ahmadmirza17
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Unsloth Bnb 4bit_gguf
Phi · AndresR2909
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 mini 4k instruct latest version July 2024 Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
PH
phi3 medmcqa finetuned Q8 0
Phi · lin789
Params3.82B
Context128K
Smallest4.1 GB
PH
Phi 4 Mini Instruct
Phi · dkumango
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
Kimlantg Phi 4 Mini Instruct Tw
Phi · elliotthwangmsa
Params3.84B
Context128K
Smallest2.5 GB
PH
Phi 4 mini reasoning gguf q4 k m
Phi · keisuke-miyako
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
phi 2.two wheeler dataset finetuned
Phi · STGYO
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · Aptronym
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 4 f16 ollama
Phi · vincentoh
Params14.7B
Context16K
Smallest29.3 GB
PH
Phi 3 Mini 4k Instruct
Phi · szaboildi
Params3.82B
Context4K
Smallest4.1 GB
PH
Phi Major Project
Phi · psychopenguin
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
Neel Madhav Phi3
Phi · Khush2007
Params3.21B
Context128K
Smallest2.0 GB
PH
Phi 4 Mini Instruct
Phi · kalle07
Params3.84B
Context128K
Smallest7.7 GB
PH
phi 2 finetuned
Phi · Stypox
Params2.78B
Context2K
Smallest1.6 GB
PH
Eggs and Bacon RP Phi 3 Q4 K M
Phi · jeiku
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
portuguese Phi3 Tom Cat 128k instruct Q4 K M
Phi · fernandovmacedo
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi-4-Mini-Reasoning
Phi · Felladrin
Params3.84B
Context128K
Smallest2.5 GB
PH
phi2 bunny Q8 0
Phi · sillykiwi
Params2.78B
Context2K
Smallest3.0 GB