GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
bagel-8b-v1.0
Bagel · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
VI
vicuna 13b v1.5 16k imatrix
Vicuna · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vicuna 7b v1.5 16k
Vicuna · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BL
Blurdus 7b v0.1 imatrix
Blurdus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Llama 3.1 8B Lexi Uncensored V2 imatrix
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BO
Borealis 10.7B
Borealis · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
Gemma 3 27b It
Gemma · duyntnet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
Hermes 3 Llama 3.2 3B imatrix
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
YI
Faro Yi 9B DPO
Yi · duyntnet
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
LL
llama-3-cat-8b-instruct-v1
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 4 imatrix
Phi · duyntnet
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GO
Gorilla Openfunctions v2
Gorilla · duyntnet
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
PH
phi 2 imatrix
Phi · duyntnet
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SA
Sailor-7B-Chat
Sailor · duyntnet
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
VI
Virtuoso Small
Virtuoso · duyntnet
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
RO
rocket-3B
Rocket · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
GE
Tiger Gemma 9B v3 imatrix
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LE
Lelanta lake 7b imatrix
Lelanta · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CH
Chihiro-7B-v0.1
Chihiro · duyntnet
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
GL
GLM 4 9B 0414
GLM · duyntnet
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
SM
Smart Lemon Cookie 7B imatrix
Smart · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM2 1.7B Instruct imatrix
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · duyntnet
Params7B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
AL
ALMA-13B-R
Alma · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
GLM 4 32B 0414
GLM · duyntnet
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
QW
Qwen3 1.7B
Qwen · duyntnet
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use

Keep browsing