GGUF models by ND911
46 GGUF models quantized by ND911 on Hugging Face. Sizes run from 2.47B to 20B parameters. The longest trained context is 1000K tokens.
ST
SD35 Blur Canny Depth
Stable · ND911
Params11.1B
Context512
Smallest5.1 GB
EC
Eclectic Maid 10B v3
Eclectic · ND911
Params10.7B
Context32K
Q4_K_M6.5 GB
TR
TruBass v2
Trubass · ND911
Params11.9B
Context—
Smallest6.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · ND911
Params12.2B
Context1000K
Smallest13.0 GB
EC
Eclectic Maid 10B v2
Eclectic · ND911
Params10.5B
Context32K
Q4_K_M6.3 GB
FR
Franken Merlinite Maid
Fraken · ND911
Params10.5B
Context8K
Smallest7.7 GB
MI
Mistralv0.2 Erosumikav2 Franken Sonya 10.5B
Mistral · ND911
Params10.5B
Context8K
Q4_K_M6.3 GB
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · ND911
Params12.2B
Context128K
Smallest13.0 GB
EC
EclecticEuphoria Flux Schnell Libre
Eclecticeuphoria · ND911
Params11.9B
Context—
Smallest7.0 GB
MI
Franken Mistral Merlinite Maid 10B
Mistral · ND911
Params10.5B
Context8K
Smallest11.2 GB
FR
Fraken Maid TW K Slerp
Fraken · ND911
Params7.24B
Context8K
Smallest7.7 GB
AL
Altair Stock 12B v1
Altair · ND911
Params12.2B
Context128K
Smallest13.0 GB
LO
EE Silicon Maid 7B slerp
Loyal · ND911
Params7.24B
Context8K
Smallest7.7 GB
MI
Franken Mistral Maid TWK Slerp
Mistral · ND911
Params7.24B
Context8K
Smallest7.7 GB
IN
MN 12B RP Ink Longform MPOA
Ink · ND911
Params12.2B
Context128K
Smallest13.0 GB
MI
Franken Mistral Merlinite Maid
Mistral · ND911
Params7.24B
Context8K
Smallest7.7 GB