GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
BA
bagel-8b-v1.0
Bagel · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
VI
vicuna 13b v1.5 16k imatrix
Vicuna · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vicuna 7b v1.5 16k
Vicuna · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
BL
Blurdus 7b v0.1 imatrix
Blurdus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Lexi Uncensored V2 imatrix
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
BO
Borealis 10.7B
Borealis · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Gemma 3 27b It
Gemma · duyntnet
Params27B
Context128K
Q4_K_M16.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Hermes 3 Llama 3.2 3B imatrix
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
YI
Faro Yi 9B DPO
Yi · duyntnet
Params8.83B
Context32K
Q4_K_M5.3 GB
LL
llama-3-cat-8b-instruct-v1
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 4 imatrix
Phi · duyntnet
Params14.7B
Context16K
Q4_K_M9.1 GB
GO
Gorilla Openfunctions v2
Gorilla · duyntnet
Params6.91B
Context4K
Q4_K_M4.2 GB
PH
phi 2 imatrix
Phi · duyntnet
Params2.78B
Context2K
Q4_K_M1.7 GB
SA
Sailor-7B-Chat
Sailor · duyntnet
Params7.72B
Context32K
Q4_K_M4.8 GB
VI
Virtuoso Small
Virtuoso · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
RO
rocket-3B
Rocket · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GE
Tiger Gemma 9B v3 imatrix
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
LE
Lelanta lake 7b imatrix
Lelanta · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 2b Jpn It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
Chihiro-7B-v0.1
Chihiro · duyntnet
Params7.49B
Context32K
Q4_K_M4.5 GB
GL
GLM 4 9B 0414
GLM · duyntnet
Params9.4B
Context32K
Q4_K_M6.2 GB
SM
Smart Lemon Cookie 7B imatrix
Smart · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 1.7B Instruct imatrix
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen2-7B-Instruct
Qwen · duyntnet
Params7B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
AL
ALMA-13B-R
Alma · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GL
GLM 4 32B 0414
GLM · duyntnet
Params32.6B
Context32K
Q4_K_M19.7 GB
QW
Qwen3 1.7B
Qwen · duyntnet
Params2.03B
Context40K
Q4_K_M1.3 GB