Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
phi 4 mini reasoning finetuned 150 steps
Phi · nex1ff
Params3.84B
Context128K
Smallest7.7 GB
ReasoningTool use
PH
meha_html_model
Phi · jawerty
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
slim q gen phi 3 tool
Phi · llmware
Params3.82B
Context4K
Smallest2.4 GB
Tool use
PH
phi3 code func lang alpaca merged
Phi · jtatman
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding
PH
Phi 4 Mini Instruct
Phi · colxi
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · harisnaeem
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3 Mini 4k Instruct
Phi · psychopenguin
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
PH
KCAD SLM
Phi · shaythuram
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi4_10_Epoch
Phi · Kei5uke
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Mini Instruct Heretic v1.2
Phi · grayarea
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
KimLanpure phi 3 zh
Phi · elliotthwang
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo5epoch v7
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
phi model 2000
Phi · Sahil2507
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3 Medium 4k Instruct Sq
Phi · NikolayKozloff
Params66M
Context—
Smallest0.3 GB
GGUF
PH
PycodeAllTestone
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · aifeifei799
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
Phi 4 ur fall bnb 4bit
Phi · mervinpraison
Params14.7B
Context16K
Q4_K_M8.9 GB
Tool use
PH
Phi 3.5 mini instruct reasoning
Phi · n4ze3m
Params3.82B
Context128K
Q4_K_M2.3 GB
Reasoning
PH
Phi 3 mini 4k Python Vezora143k gguf f16
Phi · Montecarlo2024
Params3.82B
Context4K
Smallest7.6 GB
GGUF
PH
awelitoLLM phi 4b 128k
Phi · fbeawels
Params3.82B
Context128K
Smallest7.6 GB
Coding
PH
Phi 3.5 Mini Instruct
Phi · NexesQuants
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
nullai phi 4 14b v2
Phi · kofdai
Params14.7B
Context16K
Smallest29.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · keisuke-miyako
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
phi 4 45b
Phi · mradermacher
Params45.3B
Context16K
Q4_K_M27.8 GB
GGUF
PH
phi3 finetuned olscience merged Q4 K M
Phi · farikaw599
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 11B
Phi · ramgpt
Params11B
Context16K
Q4_K_M11.5 GB
GGUF
PH
phi 2
Phi · 1bit-MONSTER
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PH
Phi-3-mini-4k-CodeInstruct-GGUF_q8_0
Phi · actualbrain
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · itlwas
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
PH
phi 3 mini 4k it portuguese tom cat Q4 K M chunked
Phi · BoscoTheDog
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding

Keep browsing