GGUF models by Shay1309
52 GGUF models quantized by Shay1309 on Hugging Face. Sizes run from 362M to 3.82B parameters. The longest trained context is 128K tokens.
AH
AHAH
Ahah · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
GG
gguf test
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
PH
Responses Testing
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
Responses Testing2
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
GGUF AMODFull
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
repo
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
AH
AHAHRAS
Ahahras · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
PH
fullsendbaby1
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
fullrun
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
ME
Medical CPT
Medical · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
GG
gguf med
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
FS
fsiz
Fsiz · Shay1309
Params3.61B
Context128K
Smallest7.2 GB
PH
QUID
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
GGUF VERI
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
RE
repo test full 1
Repo · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
PH
GGUF BIOMED
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
PH
GGUF BIOMEDN
Phi · Shay1309
Params3.82B
Context128K
Smallest4.1 GB
FU
fullsend finale sk
Fullsend · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
DS
dsdsdsds
Dsdsdsds · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
DA
dataset
Dataset · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
GG
gguf from deep
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
RE
reponame
Reponame · Shay1309
Params3.61B
Context128K
Smallest3.8 GB