GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
Pydevmini1
Pydevmini · duyntnet
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
FI
Fimbulvetr-11B-v2
Fimbulvetr · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ZE
zephyr-7b-beta
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
c4ai-command-r-v01
Command R · duyntnet
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
MI
Ministral 3b instruct imatrix
Mistral · duyntnet
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 7B imatrix
Nemotron · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · duyntnet
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MA
Maverick 7B imatrix
Maverick · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
chronos-13b-v2
Chronos · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
MagicPrompt-Stable-Diffusion
Magicprompt · duyntnet
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · duyntnet
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PH
Phi Lthy4
Phi · duyntnet
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
PH
phillama-3.8b-v1
Phillama · duyntnet
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
DO
DocsGPT-7B
Docsgpt · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · duyntnet
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
GR
Granite 3.1 8b Instruct
Granite · duyntnet
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
IN
INTELLECT 1 Instruct
Intellect · duyntnet
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
LL
Impish_LLAMA_4B
Llama · duyntnet
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
TO
ToppyCox 7B imatrix
Toppycox · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arcee Blitz
Arcee · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
BL
bloom 3b imatrix
Bloom · duyntnet
Params3.64B
Context3K
Q4_K_M2.4 GB
GGUF
BU
BuRPris Remix 7B imatrix
Burpris · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 32b
Aya · duyntnet
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
GR
GritLM-7B
Gritlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmallThinker 3B Preview
Smallthinker · duyntnet
Params3.4B
Context32K
Q4_K_M2.1 GB
GGUF
MI
flammen21X mistral 7B imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arcee VyLinh imatrix
Arcee · duyntnet
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use

Keep browsing