GGUF models by duyntnet
305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
KU
Kunoichi-DPO-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openchat-3.5-0106
Openchat · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Meta-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Neural una cybertron 7b imatrix
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
TableLLM 13b
Tablellm · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
NA
Narwhal-7b-v3
Narwhal · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous-Hermes-2-SOLAR-10.7B
Nous · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
OL
OLMo-1.7-7B-hf
OLMo · duyntnet
Params6.89B
Context4K
Q4_K_M4.2 GB
VI
Vistral-7B-Chat
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
BL
Blue-Orchid-2x7b
Blue · duyntnet
Params12.9B
Context8K
Q4_K_M7.8 GB
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
KI
MythoMax L2 Kimiko v2 13b imatrix
Kimi · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
CO
Codefu 7b v0.1
Codefu · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
ST
stablelm-zephyr-3b
Stablelm · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
JE
Jellyfish-13B
Jellyfish · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
IC
IceLatteRP-7b
Icelatterp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
C4Ai Command R7B 12 2024
Command R · duyntnet
Params8.03B
Context8K
Q4_K_M5.1 GB
GE
Genstruct-7B
Genstruct · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
LongWriter Glm4 9b
GLM · duyntnet
Params9.4B
Context1024K
Q4_K_M6.3 GB
QW
Qwen2.5 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
Delexa-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM-3B-OpenHermes-2.5-v2
MiniCPM · duyntnet
Params3.01B
Context2K
Q4_K_M2.0 GB
MI
MiniMA-3B
Minima · duyntnet
Params3.02B
Context4K
Q4_K_M1.8 GB
LL
Meta Llama 3.1 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Codestral-22B-v0.1
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
HA
HamSter-0.2
Hamster · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · duyntnet
Params8.41B
Context8K
Q4_K_M5.1 GB