GGUF models by ND911

46 GGUF models quantized by ND911 on Hugging Face. Sizes run from 2.47B to 20B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
SD35 Blur Canny Depth
Stable · ND911
Params11.1B
Context512
Smallest5.1 GB
GGUF
EC
Eclectic Maid 10B v3
Eclectic · ND911
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TR
TruBass v2
Trubass · ND911
Params11.9B
Context—
Smallest6.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · ND911
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
EC
Eclectic Maid 10B v2
Eclectic · ND911
Params10.5B
Context32K
Q4_K_M6.3 GB
GGUF
FR
Franken Merlinite Maid
Fraken · ND911
Params10.5B
Context8K
Smallest7.7 GB
GGUF
MI
Mistralv0.2 Erosumikav2 Franken Sonya 10.5B
Mistral · ND911
Params10.5B
Context8K
Q4_K_M6.3 GB
GGUF
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · ND911
Params12.2B
Context128K
Smallest13.0 GB
GGUF
EC
EclecticEuphoria Flux Schnell Libre
Eclecticeuphoria · ND911
Params11.9B
Context—
Smallest7.0 GB
GGUF
MI
Franken Mistral Merlinite Maid 10B
Mistral · ND911
Params10.5B
Context8K
Smallest11.2 GB
GGUF
FR
Fraken Maid TW K Slerp
Fraken · ND911
Params7.24B
Context8K
Smallest7.7 GB
GGUF
AL
Altair Stock 12B v1
Altair · ND911
Params12.2B
Context128K
Smallest13.0 GB
Tool use
LO
EE Silicon Maid 7B slerp
Loyal · ND911
Params7.24B
Context8K
Smallest7.7 GB
GGUF
MI
Franken Mistral Maid TWK Slerp
Mistral · ND911
Params7.24B
Context8K
Smallest7.7 GB
GGUF
IN
MN 12B RP Ink Longform MPOA
Ink · ND911
Params12.2B
Context128K
Smallest13.0 GB
Roleplay
MI
Franken Mistral Merlinite Maid
Mistral · ND911
Params7.24B
Context8K
Smallest7.7 GB
GGUF

Keep browsing