GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
QW
Qwen3 8B
Qwen · duyntnet
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 2 Ataraxy 9B imatrix
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
SA
Dr_Samantha-7b
Samantha · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
RO
Rosa_Writing_3B
Rosa · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
EL
Elly 7B imatrix
Elly · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
CH
Chroma 8 steps
Chroma · duyntnet
Params8.9B
Context—
Q4_K_M5.2 GB
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepCoder 14B Preview
Deepcoder · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
WE
WEBGEN 4B Preview
Webgen · duyntnet
Params4.02B
Context256K
Q4_K_M2.5 GB
GR
Granite 3.0 8b Instruct
Granite · duyntnet
Params8.17B
Context4K
Q4_K_M4.9 GB
GE
Gemmasutra Small 4B v1 imatrix
Gemma · duyntnet
Params3.86B
Context8K
Q4_K_M2.5 GB
SA
Saul-Instruct-v1
Saul · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
NP
NPC LLM 7B imatrix
Npc · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 9b It WPO HB
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
FA
Falcon3 10B Instruct
Falcon · duyntnet
Params10.3B
Context32K
Q4_K_M6.3 GB
DA
Darkest muse v1 imatrix
Darkest · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
FA
Falcon3 7B Instruct
Falcon · duyntnet
Params7.46B
Context32K
Q4_K_M4.6 GB
ME
Megrez 3B Instruct
Megrez · duyntnet
Params2.92B
Context32K
Q4_K_M1.8 GB
RE
Reka Flash 3
Reka · duyntnet
Params20.9B
Context32K
Q4_K_M13.6 GB
AR
Arcee Maestro 7B Preview imatrix
Arcee · duyntnet
Params7.61B
Context128K
Q4_K_M4.7 GB
ER
ErisMaidFlame 7B imatrix
Erismaidflame · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
ER
Eros Scribe 7b imatrix
Eros · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
EV
EvolCodeLlama 7b imatrix
Evolcodellama · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
ST
starcoder2-7b
StarCoder · duyntnet
Params7.17B
Context16K
Q4_K_M4.5 GB
DU
Dusk_Rainbow
Dusk · duyntnet
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Qwen3 14B
Qwen · duyntnet
Params14.8B
Context40K
Q4_K_M9.0 GB
GE
GemmaCoder3 12B imatrix
Gemma · duyntnet
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
Llama3-ChatQA-1.5-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
C4Ai Command R 08 2024
Command R · duyntnet
Params32.3B
Context128K
Q4_K_M19.8 GB