GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
PY
Pydevmini1
Pydevmini · duyntnet
Params4.02B
Context40K
Q4_K_M2.5 GB
FI
Fimbulvetr-11B-v2
Fimbulvetr · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 3.2 1B Instruct
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
ZE
zephyr-7b-beta
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
c4ai-command-r-v01
Command R · duyntnet
Params35B
Context128K
Q4_K_M21.5 GB
MI
Ministral 3b instruct imatrix
Mistral · duyntnet
Params3.32B
Context128K
Q4_K_M2.0 GB
NE
OpenCodeReasoning Nemotron 1.1 7B imatrix
Nemotron · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · duyntnet
Params8.19B
Context40K
Q4_K_M5.0 GB
MA
Maverick 7B imatrix
Maverick · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
chronos-13b-v2
Chronos · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
MA
MagicPrompt-Stable-Diffusion
Magicprompt · duyntnet
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen2.5 14B Instruct
Qwen · duyntnet
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Phi Lthy4
Phi · duyntnet
Params11.9B
Context16K
Q4_K_M7.3 GB
PH
phillama-3.8b-v1
Phillama · duyntnet
Params3.82B
Context4K
Q4_K_M2.3 GB
OP
openchat-3.6-8b-20240522
Openchat · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 32B Instruct
Qwen · duyntnet
Params32.8B
Context32K
Q4_K_M19.9 GB
DO
DocsGPT-7B
Docsgpt · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
AE
L3-Aethora-15B-V2
Aethora · duyntnet
Params15B
Context8K
Q4_K_M9.1 GB
GR
Granite 3.1 8b Instruct
Granite · duyntnet
Params8.17B
Context128K
Q4_K_M4.9 GB
IN
INTELLECT 1 Instruct
Intellect · duyntnet
Params10.2B
Context8K
Q4_K_M6.2 GB
LL
Impish_LLAMA_4B
Llama · duyntnet
Params4.51B
Context128K
Q4_K_M2.8 GB
TO
ToppyCox 7B imatrix
Toppycox · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Arcee Blitz
Arcee · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
BL
bloom 3b imatrix
Bloom · duyntnet
Params3.64B
Context3K
Q4_K_M2.4 GB
BU
BuRPris Remix 7B imatrix
Burpris · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Aya Expanse 32b
Aya · duyntnet
Params32.3B
Context8K
Q4_K_M19.8 GB
GR
GritLM-7B
Gritlm · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmallThinker 3B Preview
Smallthinker · duyntnet
Params3.4B
Context32K
Q4_K_M2.1 GB
MI
flammen21X mistral 7B imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Arcee VyLinh imatrix
Arcee · duyntnet
Params3.4B
Context32K
Q4_K_M2.1 GB