GGUF models by jsfs11

49 GGUF models quantized by jsfs11 on Hugging Face. Sizes run from 6.29B to 32.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NemoMerge 12B DellaV1b Q8 0
Nemomerge · jsfs11
Params12.2B
Context1000K
Smallest13.0 GB
Roleplay
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
MI
MixtureofMerges MoE 4x7b v5
Mixtureofmerges · jsfs11
Params24.2B
Context32K
Smallest17.1 GB
GGUF
WI
WildMBXMarconi SLERP 7B
Wildmbxmarconi · jsfs11
Params7.24B
Context32K
Smallest5.9 GB
GGUF
MI
MixtureofMerges-MoE-2x7b-SLERPv0.9
Mixtureofmerges · jsfs11
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
WE
WestOrcaMonarch-DPO-7B
Westorcamonarch · jsfs11
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
MixtureofMerges-MoE-4x7b-v10-mixtralv0.3
Mistral · jsfs11
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
MixtureofMerges MoE 2x7b v6
Mixtureofmerges · jsfs11
Params12.9B
Context32K
Smallest9.1 GB
GGUF
RA
RandomMergeNoNormWEIGHTED 7B MODELSTOCK
Randommergenonormweighted · jsfs11
Params7.24B
Context32K
Smallest5.1 GB
GGUF
MO
Model Stock Mixv0.1 7B
Model · jsfs11
Params7.24B
Context32K
Smallest4.1 GB
GGUF
QW
QWQ EVA Preview SLERP 32b Q4 K S
Qwen · jsfs11
Params32.8B
Context128K
Smallest18.8 GB
ReasoningTool use
TA
L3-8B-Tamamo-v1
Tamamo · jsfs11
Params8.03B
Context8K
Smallest5.7 GB
GGUF
RA
RandomMergeNoNormWEIGHTED 7B 2x7BMOE
Randommergenonormweighted · jsfs11
Params12.9B
Context32K
Smallest9.1 GB
GGUF
BI
MixtureofMerges-MoE-4x7bRP-v11
Biomistral · jsfs11
Params24.2B
Context32K
Q4_K_M14.6 GB
RoleplayVision
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Smallest16.0 GB
GGUF
ST
L3-8B-Stheno-slerp
Stheno · jsfs11
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest14.5 GB
GGUF
BA
S1 Base 32B
Base · jsfs11
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest9.7 GB
GGUF

Keep browsing