Phi GGUF models
3486 GGUF models in the Phi family, quantized by 1216 uploaders. Sizes run from 1M to 91.7B parameters. The longest trained context is 128K tokens.
PH
Phi 3 medium 128k instruct Q4 K M
Phi · CHE-72
Params14B
Context128K
Q4_K_M8.6 GB
PH
Fine tune phi3.5 mini microsoft orca mcq split
Phi · Ishan93
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi 3 Mini 128k Instruct
Phi · Kondara
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi4 Rp1Q8
Phi · stablediffussion002
Params14.7B
Context16K
Smallest15.6 GB
PH
Phi 3.5 Mini Instruct LoRA 128
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 mini 128k instruct
Phi · ZeroWw
Params3.82B
Context128K
Smallest3.1 GB
PH
Phi 3 mini 4k Python Vezora143k q4k
Phi · Montecarlo2024
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
Phi 3.1 mini 128k instruct
Phi · neootaku
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi3_N8N_F16
Phi · NikolaiRaitschew
Params3.82B
Context128K
Smallest7.6 GB
PH
Phi3 ITA mini 4K instruct Q8 0
Phi · NikolayKozloff
Params3.82B
Context4K
Smallest4.1 GB
PH
TextSynth Phi4 14B
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
phi 4 Q4 K S
Phi · roleplaiapp
Params14.7B
Context16K
Smallest8.4 GB
PH
zelus82 Obelix Phi2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3 medium 128k 27B lingyang v0.1 Q4 K M
Phi · wwe180
Params27.6B
Context128K
Q4_K_M16.9 GB
PH
phi 2 2.7B codealpaca
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi medmcqa question generation anatomy lora i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
Phi 3.5 Mini Instruct
Phi · NikolayKozloff
Params3.82B
Context128K
Smallest4.1 GB
PH
phi 4
Phi · grapevine-AI
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Failspy Phi 3 Medium 4k Instruct Abliterated v3
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
PH
maximusLLM 3b 128k
Phi · awels
Params3.82B
Context128K
Smallest7.6 GB
PH
joke finetome model gguf phi4 20260109 044903
Phi · Mathieu-Thomas-JOSSET
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 4 Bnb 4bit
Phi · Kei5uke
Params14.7B
Context24K
Q4_K_M8.9 GB
PH
Phi medquad frequency
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
PH
GGUF Tester
Phi · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
PH
Borea Phi 3.5 Mini Instruct Coding
Phi · keitokei1994
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 4 Mini Instruct
Phi · matrixportalx
Params3.84B
Context128K
Smallest4.1 GB
PH
UwU_phi3_mini
Phi · superdrew100
Params3.82B
Context4K
Q4_K_M2.3 GB
PH
HOTFinalSample
Phi · abhijsrwala
Params14.7B
Context16K
Smallest15.6 GB