GGUF models by duyntnet

305 GGUF models quantized by duyntnet on Hugging Face. Sizes run from 163M to 35B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
KU
Kunoichi-DPO-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
openchat-3.5-0106
Openchat · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Neural una cybertron 7b imatrix
Neural · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
TableLLM 13b
Tablellm · duyntnet
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
NA
Narwhal-7b-v3
Narwhal · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous-Hermes-2-SOLAR-10.7B
Nous · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
OL
OLMo-1.7-7B-hf
OLMo · duyntnet
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
VI
Vistral-7B-Chat
Vistral · duyntnet
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Blue-Orchid-2x7b
Blue · duyntnet
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3 imatrix
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KI
MythoMax L2 Kimiko v2 13b imatrix
Kimi · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
Codefu 7b v0.1
Codefu · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
ST
stablelm-zephyr-3b
Stablelm · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JE
Jellyfish-13B
Jellyfish · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IC
IceLatteRP-7b
Icelatterp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
C4Ai Command R7B 12 2024
Command R · duyntnet
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
GE
Genstruct-7B
Genstruct · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
LongWriter Glm4 9b
GLM · duyntnet
Params9.4B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
DE
Delexa-7b
Delexa · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniCPM-3B-OpenHermes-2.5-v2
MiniCPM · duyntnet
Params3.01B
Context2K
Q4_K_M2.0 GB
Tool use
MI
MiniMA-3B
Minima · duyntnet
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
LL
Meta Llama 3.1 8B
Llama · duyntnet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Codestral-22B-v0.1
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
HA
HamSter-0.2
Hamster · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · duyntnet
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing