GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
LL
LongWriter Llama3.1 8b
Llama · duyntnet
Params8B
Context128K
Q4_K_M4.9 GB
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WizardLM-13B-Uncensored
Wizardlm · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
FS
FsfairX-Zephyr-Chat-v0.1
Fsfairx · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kunoichi-DPO-v2-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Delexa-Instruct-V0.1-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hexoteric 7B imatrix
Hexoteric · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
WizardLM-7B-Uncensored
Wizardlm · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
ST
Starling-LM-7B-alpha
Starling · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
VI
Vistral-7B-Chat-DPO
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
QW
Qwen2.5 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
PH
Phi 3 medium 4k instruct imatrix
Phi · duyntnet
Params14B
Context4K
Q4_K_M8.6 GB
UN
UNA-TheBeagle-7b-v1
Una · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
meditron-7b
Meditron · duyntnet
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · duyntnet
Params12.2B
Context1000K
Q4_K_M7.5 GB
SP
spicyboros-7b-2.2
Spicyboros · duyntnet
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
neural-chat-7b-v3-3
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB