GGUF models by jsfs11
49 GGUF models quantized by jsfs11 on Hugging Face. Sizes run from 6.29B to 32.8B parameters. The longest trained context is 1000K tokens.
NE
NemoMerge 12B DellaV1b Q8 0
Nemomerge · jsfs11
Params12.2B
Context1000K
Smallest13.0 GB
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Q4_K_M9.1 GB
MI
MixtureofMerges MoE 4x7b v5
Mixtureofmerges · jsfs11
Params24.2B
Context32K
Smallest17.1 GB
WI
WildMBXMarconi SLERP 7B
Wildmbxmarconi · jsfs11
Params7.24B
Context32K
Smallest5.9 GB
MI
MixtureofMerges-MoE-2x7b-SLERPv0.9
Mixtureofmerges · jsfs11
Params12.9B
Context32K
Q4_K_M7.8 GB
WE
WestOrcaMonarch-DPO-7B
Westorcamonarch · jsfs11
Params7.24B
Context32K
Smallest7.7 GB
MI
MixtureofMerges-MoE-4x7b-v10-mixtralv0.3
Mistral · jsfs11
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
MixtureofMerges MoE 2x7b v6
Mixtureofmerges · jsfs11
Params12.9B
Context32K
Smallest9.1 GB
RA
RandomMergeNoNormWEIGHTED 7B MODELSTOCK
Randommergenonormweighted · jsfs11
Params7.24B
Context32K
Smallest5.1 GB
MO
Model Stock Mixv0.1 7B
Model · jsfs11
Params7.24B
Context32K
Smallest4.1 GB
QW
QWQ EVA Preview SLERP 32b Q4 K S
Qwen · jsfs11
Params32.8B
Context128K
Smallest18.8 GB
TA
L3-8B-Tamamo-v1
Tamamo · jsfs11
Params8.03B
Context8K
Smallest5.7 GB
RA
RandomMergeNoNormWEIGHTED 7B 2x7BMOE
Randommergenonormweighted · jsfs11
Params12.9B
Context32K
Smallest9.1 GB
BI
MixtureofMerges-MoE-4x7bRP-v11
Biomistral · jsfs11
Params24.2B
Context32K
Q4_K_M14.6 GB
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Smallest16.0 GB
ST
L3-8B-Stheno-slerp
Stheno · jsfs11
Params8.03B
Context8K
Smallest8.5 GB
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest14.5 GB
BA
S1 Base 32B
Base · jsfs11
Params32.8B
Context128K
Q4_K_M19.8 GB
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest9.7 GB