GGUF models by Goekdeniz-Guelmez

54 GGUF models quantized by Goekdeniz-Guelmez on Hugging Face. Sizes run from 596M to 14.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
EI
J.O.S.I.E.3 Beta6 slerp
Einstein · Goekdeniz-Guelmez
Params7.24B
Context32K
Smallest3.8 GB
GGUF
BE
J.O.S.I.E.3 Beta12 7B slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
J.O.S.I.E.3 Beta11 7B slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Matter 0.1 7B boost DPO preview
Matter · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b anthropic
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
JOSIEv4o-8b-stage1-beta2.2
Stage · Goekdeniz-Guelmez
Params8.03B
Context8K
Smallest4.7 GB
GGUF
OR
J.O.S.I.E.V4O 7b Orpo Stage1 v1
Orpo · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
ST
JOSIEv4o-8b-stage1-beta1
Stage · Goekdeniz-Guelmez
Params8.03B
Context8K
Smallest4.7 GB
GGUF
OR
J.O.S.I.E.V4O 7b Orpo Stage1 v0.5
Orpo · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
JO
Josie 3b v6.0
Josie · Goekdeniz-Guelmez
Params3.09B
Context32K
Smallest2.2 GB
Tool use
JO
Josie 7b v6.0 Step2000
Josie · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
ST
JOSIEv4o-8b-stage1-beta2.3.1
Stage · Goekdeniz-Guelmez
Params8.03B
Context8K
Smallest4.7 GB
GGUF
JO
Josie 3b v6.0 Epoch1
Josie · Goekdeniz-Guelmez
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ST
j.o.s.i.e.v4o-7b-stage1-beta3.2
Stage · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JO
josie 7b v6.0 Q4 K M
Josie · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
BE
J.O.S.I.E.3 Beta7 slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Smallest3.8 GB
GGUF
BE
J.O.S.I.E.3 Beta8 slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
J.O.S.I.E.3 Beta9 7B slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ChatHercules 2.5 Mistral 7B DPO
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
josiev4o-7b-stage1-beta3.0
Stage · Goekdeniz-Guelmez
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
BE
J.O.S.I.E.3 Beta10 7B slerp
Beta · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JO
JOSIEv4o 8b stage1 v4
Josiev · Goekdeniz-Guelmez
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
JOSIEv4o-8b-stage1-beta1
Stage · Goekdeniz-Guelmez
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
JOSIEv4o-8b-stage1-beta2.2
Stage · Goekdeniz-Guelmez
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing