GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B
Qwen · duyntnet
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GE
Gemma 2 Ataraxy 9B imatrix
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SA
Dr_Samantha-7b
Samantha · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
RO
Rosa_Writing_3B
Rosa · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
EL
Elly 7B imatrix
Elly · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CH
Chroma 8 steps
Chroma · duyntnet
Params8.9B
Context—
Q4_K_M5.2 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepCoder 14B Preview
Deepcoder · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
WE
WEBGEN 4B Preview
Webgen · duyntnet
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
GR
Granite 3.0 8b Instruct
Granite · duyntnet
Params8.17B
Context4K
Q4_K_M4.9 GB
Tool use
GE
Gemmasutra Small 4B v1 imatrix
Gemma · duyntnet
Params3.86B
Context8K
Q4_K_M2.5 GB
GGUF
SA
Saul-Instruct-v1
Saul · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NP
NPC LLM 7B imatrix
Npc · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 9b It WPO HB
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · duyntnet
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
DA
Darkest muse v1 imatrix
Darkest · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · duyntnet
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
ME
Megrez 3B Instruct
Megrez · duyntnet
Params2.92B
Context32K
Q4_K_M1.8 GB
GGUF
RE
Reka Flash 3
Reka · duyntnet
Params20.9B
Context32K
Q4_K_M13.6 GB
GGUF
AR
Arcee Maestro 7B Preview imatrix
Arcee · duyntnet
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
ER
ErisMaidFlame 7B imatrix
Erismaidflame · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
ER
Eros Scribe 7b imatrix
Eros · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EV
EvolCodeLlama 7b imatrix
Evolcodellama · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ST
starcoder2-7b
StarCoder · duyntnet
Params7.17B
Context16K
Q4_K_M4.5 GB
Coding
DU
Dusk_Rainbow
Dusk · duyntnet
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 14B
Qwen · duyntnet
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GE
GemmaCoder3 12B imatrix
Gemma · duyntnet
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
LL
Llama3-ChatQA-1.5-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · duyntnet
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF

Keep browsing