GGUF models by Shay1309

52 GGUF models quantized by Shay1309 on Hugging Face. Sizes run from 362M to 3.82B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
AH
AHAH
Ahah · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
GG
gguf test
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
GGUF
PH
Responses Testing
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
Responses Testing2
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
GGUF AMODFull
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
repo
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
AH
AHAHRAS
Ahahras · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
PH
fullsendbaby1
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
fullrun
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
ME
Medical CPT
Medical · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
GG
gguf med
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
FS
fsiz
Fsiz · Shay1309
Params3.61B
Context128K
Smallest7.2 GB
Tool use
PH
QUID
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
GGUF VERI
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
RE
repo test full 1
Repo · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
GGUF
PH
GGUF BIOMED
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
PH
GGUF BIOMEDN
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GGUF
FU
fullsend finale sk
Fullsend · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
DS
dsdsdsds
Dsdsdsds · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
DA
dataset
Dataset · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
GG
gguf from deep
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
RE
reponame
Reponame · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use

Keep browsing