Yamshadowstrangemerges GGUF models

83 GGUF models in the Yamshadowstrangemerges family, quantized by 1 uploader. Sizes run from 7.24B to 7.24B parameters. The longest trained context is 32K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
YA
YamshadowStrangemerges_32_Experiment26Experiment30
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment24Yam
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_YamExperiment26
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_AlloyingotneoyInex12
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment28Experiment26
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment27Pastiche
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_YamshadowT3q
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Inex12Yamshadow
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment24Alloyingotneoy
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Strangemerges_32Experiment28
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_ShadowYamshadow
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Multi_verse_modelExperiment28
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment24Experiment28
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment28Neuralsirkrishna
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment29Multi_verse_model
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment26Neuralarjuna
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_T3qm7xpExperiment26
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment29Experiment24
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_AlloyingotneoyNeuralsirkrishna
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_YamT3qm7xp
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Inex12Yam
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_NeuralExperiment26
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_AlloyingotneoyPercival_01
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_NeuralsirkrishnaM7
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Ognoexperiment27Multi_verse_model
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Neuralsirkrishnaexperiment26Experiment24
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Multi_verse_modelM7
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment28Yam
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_ShadowNeuralsirkrishna
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
YamshadowStrangemerges_32_Experiment28Meliodas
Yamshadowstrangemerges · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

About the Yamshadowstrangemerges GGUF models

Yamshadowstrangemerges is represented on ggufmodels.com by 83 GGUF models, quantized by 1 uploader on Hugging Face. The most downloaded are YamshadowStrangemerges_32_Experiment26Experiment30, YamshadowStrangemerges_32_Experiment24Yam and YamshadowStrangemerges_32_YamExperiment26. Parameter counts run from 7.24B to 7.24B, and the longest trained context window is 32K tokens.

A Q4_K_M file of a Yamshadowstrangemerges model is between 4.4 to 4.4 GB, which is the quant most people start with. Most files come from mradermacher (83). The quants you will meet most often are Q8_0 (83), Q6_K (83), Q5_K_S (83) and Q5_K_M (83), where the number is how many models offer that quant.

Frequently asked questions

Which Yamshadowstrangemerges GGUF should I download?

The most downloaded Yamshadowstrangemerges GGUF here is YamshadowStrangemerges_32_Experiment26Experiment30. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Yamshadowstrangemerges model need?

Q4_K_M files of Yamshadowstrangemerges models on this site range from 4.4 to 4.4 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Yamshadowstrangemerges GGUF files come from?

The most common quantizers here are mradermacher. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing