Phi GGUF models

3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PH
Phi 3 medium 128k instruct Q4 K M
Phi · CHE-72
Params14B
Context128K
Q4_K_M8.6 GB
Coding
PH
Fine tune phi3.5 mini microsoft orca mcq split
Phi · Ishan93
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · Kondara
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi4 Rp1Q8
Phi · stablediffussion002
Params14.7B
Context16K
Smallest15.6 GB
GGUF
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
GGUF
PH
Phi 3 mini 4k Python Vezora143k q4k
Phi · Montecarlo2024
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
Phi 3.1 mini 128k instruct
Phi · neootaku
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding
PH
Phi3_N8N_F16
Phi · NikolaiRaitschew
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
Phi3 ITA mini 4K instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
GGUF
PH
TextSynth Phi4 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
phi 4 Q4 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest8.4 GB
Coding
PH
zelus82 Obelix Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 medium 128k 27B lingyang v0.1 Q4 K M
Phi · wwe180
Params27.6B
Context128K
Q4_K_M16.9 GB
GGUF
PH
phi 2 2.7B codealpaca
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi medmcqa question generation anatomy lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
Coding
PH
phi 4
Phi · grapevine-AI
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
PH
Failspy Phi 3 Medium 4k Instruct Abliterated v3
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
Coding
PH
maximusLLM 3b 128k
Phi · awels
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PH
joke finetome model gguf phi4 20260109 044903
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
Phi 4 Bnb 4bit
Phi · Kei5uke
Params14.7B
Context24K
Q4_K_M8.9 GB
GGUF
PH
Phi medquad frequency
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
PH
GGUF Tester
Phi · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · keitokei1994
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Smallest4.1 GB
CodingTool use
PH
UwU_phi3_mini
Phi · superdrew100
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
PH
HOTFinalSample
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB
GGUF

Keep browsing