GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
WI
WizardLM-13B-Uncensored
Wizardlm · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FS
FsfairX-Zephyr-Chat-v0.1
Fsfairx · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunoichi-DPO-v2-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ST
Starling-LM-7B-alpha
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
VI
Vistral-7B-Chat-DPO
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
UN
UNA-TheBeagle-7b-v1
Una · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NE
neural-chat-7b-v3-3
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing