GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WizardLM-13B-V1.2
Wizardlm · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
glm-4-9b-chat
GLM · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
NO
Nous-Capybara-3B-V1.9
Nous · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
XW
Xwin-MLewd-13B-V0.2
Xwin · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardLM-2-7B
Wizardlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling-LM-7B-beta
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DA
Dans AdventurousWinds 7b
Dans · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestLake-7B-v2
Westlake · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
stable-code-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
SA
Sailor-14B-Chat
Sailor · duyntnet
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
GE
Gemma 2 27b It
Gemma · duyntnet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · duyntnet
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing