GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
GE
Gemma 3 12b It
Gemma · duyntnet
Params11.8B
Context128K
Q4_K_M7.3 GB
LY
MN 12B Lyra v1 imatrix
Lyra · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Cogito v1 Preview Qwen 14B
Qwen · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 Coder 14B
Qwen · duyntnet
Params14.8B
Context32K
Q4_K_M9.0 GB
AN
Antler-7B-evolve
Antler · duyntnet
Params7.24B
Context4K
Q4_K_M4.4 GB
MA
Matter 0.2 7B
Matter · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
OP
Open StarLake Swap 7B imatrix
Open · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Viking 7B
Viking · duyntnet
Params7.55B
Context4K
Q4_K_M4.6 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · duyntnet
Params4.51B
Context128K
Q4_K_M2.8 GB
MI
Elysia Trismegistus Mistral 7B v02
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
Hamanasu 15B Instruct imatrix
Hamanasu · duyntnet
Params14.7B
Context16K
Q4_K_M8.9 GB
GE
Gemma 3 4b It
Gemma · duyntnet
Params3.88B
Context128K
Q4_K_M2.5 GB
PH
Phi 4 Mini Instruct
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
OP
OpenOrcaxOpenChat Preview2 13B imatrix
Openorcaxopenchat · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · duyntnet
Params15.7B
Context160K
Q4_K_M10.4 GB
BI
BioMistral-7B
Biomistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llemma_7b
Llemma · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
GRMR 2B Instruct imatrix
Grmr · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
PS
Psyfighter-13B
Psyfighter · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
SE
SeaLLM3-7B-Chat
Seallm · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
SQ
sqlcoder-7b-2
Sqlcoder · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
QwQ LCoT 7B Instruct imatrix
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Ministral 8B Instruct 2410
Mistral · duyntnet
Params8.02B
Context32K
Q4_K_M4.9 GB
LL
Cogito v1 Preview Llama 3B
Llama · duyntnet
Params3.61B
Context128K
Q4_K_M2.2 GB
BE
Beagle14 7B
Beagle · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-2-7b-chat-hf
Llama · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
MO
Moistral 11B v3 imatrix
Moistral · duyntnet
Params10.7B
Context8K
Q4_K_M6.5 GB
SA
Sailor2 8B Chat
Sailor · duyntnet
Params8.55B
Context32K
Q4_K_M5.2 GB
PE
Percival_01-7b-slerp
Percival · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB