GGUF models by v000000

34 GGUF models quantized by v000000 on Hugging Face. Sizes run from 7.24B to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NI
L3.1 Niitorm 8B LATCOSx2 Version GGUFs IMATRIX
Niitorm · v000000
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NI
L3.1 Niitorm 8B DPO t0.0001 GGUFs IMATRIX
Niitorm · v000000
Params8.03B
Context128K
Smallest4.4 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4
Llama · v000000
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MA
Manticore-13b-Chat-Pyg-Guanaco
Manticore · v000000
Params13B
Context2K
Smallest9.2 GB
GGUF
MI
Typhon Mixtral v1 imatrix v2.Q6 K
Mistral · v000000
Params46.7B
Context32K
Smallest38.4 GB
GGUF
QW
Qwen2.5 Lumen 14B Q6 K
Qwen · v000000
Params14.8B
Context32K
Smallest12.1 GB
RoleplayTool use
QW
Qwen2.5 14B Gutenberg 1e Delta Q6 K
Qwen · v000000
Params14.8B
Context32K
Smallest12.1 GB
Tool use
ST
L3.1 Sthenorm 8B Q8 0
Sthenorm · v000000
Params8.03B
Context128K
Smallest8.5 GB
GGUF
SW
SwallowMaid-8B-L3-SPPO-abliterated
Swallowmaid · v000000
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MY
L3-15B-MythicalMaid-t0.0001
Mythicalmaid · v000000
Params15B
Context8K
Smallest10.7 GB
GGUF
YA
YamWizard28 7B Q8 0
Yamwizard · v000000
Params7.24B
Context32K
Smallest7.7 GB
GGUF
PS
Psyonic-Rose-20B-Higher-Quality
Psyonic · v000000
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
UM
L3 Umbral Storm 8B t0.0001 Q8 0
Umbral · v000000
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ET
L3-15B-EtherealMaid-t0.0001
Etherealmaid · v000000
Params15B
Context8K
Smallest10.7 GB
GGUF
ES
MN 12B Estrella v1 Q6 K
Estrella · v000000
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
HA
HaloMaidRP v1.33 15B L3 Q5 K M
Halomaidrp · v000000
Params15B
Context8K
Smallest10.7 GB
GGUF
NI
L3.1 Niitorm 8B t0.0001 Q8 0
Niitorm · v000000
Params8.03B
Context128K
Smallest8.5 GB
Tool use
MY
MysticGem-v1.3-Guanaco-L2-13B
Mysticgem · v000000
Params13B
Context4K
Smallest10.7 GB
GGUF
ES
MN 12B Estrella v2.2 Q6 K
Estrella · v000000
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
LY
NM 12B Lyris dev 3 Q6 K
Lyris · v000000
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
LL
Llama-3-Instruct-15B-SPPO-Iter3-SH
Llama · v000000
Params15B
Context8K
Smallest10.7 GB
GGUF
MY
MysticGem v1.3 L2 13B Q5 K M
Mysticgem · v000000
Params13B
Context4K
Smallest9.2 GB
GGUF
MY
MysticGem-v1.3-L2-13B
Mysticgem · v000000
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SY
SyntheticMoist-11B
Syntheticmoist · v000000
Params10.7B
Context4K
Smallest8.8 GB
GGUF
NI
L3.1 Niitorm 8B t0.0001 i1 imatrix Q8 0
Niitorm · v000000
Params8.03B
Context128K
Smallest8.5 GB
Tool use
SY
SyntheticMoist-11B-v2
Syntheticmoist · v000000
Params10.7B
Context4K
Smallest8.8 GB
GGUF
ST
L3.1 Storniitova 8B Q8 0
Storniitova · v000000
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MY
MysticGem-v1.3-L2-13B
Mysticgem · v000000
Params13B
Context4K
Smallest7.4 GB
GGUF
MY
MysticGem-L2-13B
Mysticgem · v000000
Params13B
Context4K
Smallest9.2 GB
GGUF
DU
DupletBoreas-7B-t0.0001
Dupletboreas · v000000
Params7.24B
Context32K
Smallest7.7 GB
GGUF

About v000000 on Hugging Face

v000000 has published 34 GGUF models that ggufmodels.com tracks, across families such as Mysticgem, Niitorm and Tripletboreas. The most downloaded are L3.1 Niitorm 8B LATCOSx2 Version GGUFs IMATRIX, L3.1 Niitorm 8B DPO t0.0001 GGUFs IMATRIX and Llama 3.1 8B Stheno v3.4.

The quants v000000 publishes most often are Q6_K (14), Q8_0 (13), Q5_K_M (8) and Q5_K_S (4). Their Q4_K_M files range from 4.9 to 12.0 GB. Parameter counts run from 7.24B to 46.7B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has v000000 published?

34 models are listed here, mainly from the Mysticgem, Niitorm and Tripletboreas families. The most downloaded is L3.1 Niitorm 8B LATCOSx2 Version GGUFs IMATRIX.

Which quants does v000000 publish?

The most common are Q6_K (14 models), Q8_0 (13 models), Q5_K_M (8 models) and Q5_K_S (4 models).

Keep browsing