GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
Chaos_RP_l3_8B
Chaos · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
Qwen2.5 Coder 3B
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
GE
Gemma 3 1b It
Gemma · duyntnet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
IC
IceCoffeeRP 7b imatrix
Icecoffeerp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · duyntnet
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
ST
Storytime 13b
Storytime · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Writing_Partner_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Impish_LLAMA_3B
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MY
X MythoChronos 13B imatrix
Mythochronos · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TA
Taurus 7B 1.0 imatrix
Taurus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
BigL 7B imatrix
Bigl · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 4B
Qwen · duyntnet
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
PH
Phi 4 Mini Reasoning
Phi · duyntnet
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
KU
kukulemon 7B imatrix
Kukulemon · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
AceReason Nemotron 1.1 7B
Nemotron · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
LLAMA 3_8B_Unaligned_BETA
Llama · duyntnet
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · duyntnet
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
AP
Apollo 7B
Apollo · duyntnet
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
FO
Foundation_3B
Foundation · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
NY
Nyan Stunna 7B imatrix
Nyan · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EI
Einstein-v6-7B
Einstein · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Tessa Rust T1 7B
Tessa · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
ER
Erebus Holodeck 7B imatrix
Erebus · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MN 12B Mag Mell R1 imatrix
Mag · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
UT
UTENA 7B NSFW V2
Utena · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Orca-2-13b
Orca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Cogito v1 Preview Llama 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
TE
TenyxChat-7B-v1
Tenyxchat · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
PH
Maika Buddy 3B8 Phi3 imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
AZ
Azzurro
Azzurro · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing