GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 12b It
Gemma · duyntnet
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
LY
MN 12B Lyra v1 imatrix
Lyra · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Cogito v1 Preview Qwen 14B
Qwen · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen2.5 Coder 14B
Qwen · duyntnet
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
AN
Antler-7B-evolve
Antler · duyntnet
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MA
Matter 0.2 7B
Matter · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
OP
Open StarLake Swap 7B imatrix
Open · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
Viking 7B
Viking · duyntnet
Params7.55B
Context4K
Q4_K_M4.6 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · duyntnet
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
MI
Elysia Trismegistus Mistral 7B v02
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
Hamanasu 15B Instruct imatrix
Hamanasu · duyntnet
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
GE
Gemma 3 4b It
Gemma · duyntnet
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
PH
Phi 4 Mini Instruct
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
OP
OpenOrcaxOpenChat Preview2 13B imatrix
Openorcaxopenchat · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
BI
BioMistral-7B
Biomistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llemma_7b
Llemma · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
GRMR 2B Instruct imatrix
Grmr · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PS
Psyfighter-13B
Psyfighter · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
SeaLLM3-7B-Chat
Seallm · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
SQ
sqlcoder-7b-2
Sqlcoder · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
QwQ LCoT 7B Instruct imatrix
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
MI
Ministral 8B Instruct 2410
Mistral · duyntnet
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
LL
Cogito v1 Preview Llama 3B
Llama · duyntnet
Params3.61B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
BE
Beagle14 7B
Beagle · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-2-7b-chat-hf
Llama · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MO
Moistral 11B v3 imatrix
Moistral · duyntnet
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
SA
Sailor2 8B Chat
Sailor · duyntnet
Params8.55B
Context32K
Q4_K_M5.2 GB
GGUF
PE
Percival_01-7b-slerp
Percival · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing