GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
WI
WizardLM-13B-V1.2
Wizardlm · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GL
glm-4-9b-chat
GLM · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
QwQ 32B Preview
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
CO
Codegeex4 All 9b
Codegeex · duyntnet
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
NO
Nous-Capybara-3B-V1.9
Nous · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
XW
Xwin-MLewd-13B-V0.2
Xwin · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
WI
WizardLM-2-7B
Wizardlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
ST
Starling-LM-7B-beta
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
stable-code-instruct-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
LL
Meta Llama 3.1 8B Instruct
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova Lite
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
Dans AdventurousWinds 7b
Dans · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
WestLake-7B-v2
Westlake · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
stable-code-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
SA
Sailor-14B-Chat
Sailor · duyntnet
Params14.2B
Context32K
Q4_K_M9.2 GB
GE
Gemma 2 27b It
Gemma · duyntnet
Params27.2B
Context8K
Q4_K_M16.6 GB
PH
Phi SoSerious Mini V1 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · duyntnet
Params12.2B
Context128K
Q4_K_M7.5 GB
NE
NexusRaven-V2-13B
Nexusraven · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
PY
pygmalion-2-7b
Pygmalion · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB