GGUF models by second-state

291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi-1.5-9B-Chat-16K
Yi · second-state
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · second-state
Params7.82B
Context32K
Q4_K_M4.8 GB
Coding
FA
Falcon3 3B Instruct
Falcon · second-state
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
QW
QwQ 32B
Qwen · second-state
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
SM
SmolLM3 3B
SmolLM · second-state
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
LL
Llama3-8B-Chinese-Chat
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FL
FLUX.1 Redux dev
Flux · second-state
Params65M
Context—
Smallest0.0 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · second-state
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
OP
OpenChat 3.5 0106
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
llm-compiler-13b
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Qwen2 Math 72B Instruct
Qwen · second-state
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
TR
Triplex
Triplex · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
LL
llm-compiler-13b-ftd
Llm · second-state
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OP
openchat 3.5 1210
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen2 Math 7B Instruct
Qwen · second-state
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
EX
EXAONE Deep 7.8B
Exaone · second-state
Params7.82B
Context32K
Q4_K_M4.8 GB
Coding
DA
datagemma rag 27b it
Datagemma · second-state
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · second-state
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
OP
OpenChat 3.5
Openchat · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 7B Instruct 1M
Qwen · second-state
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
SK
Sky T1 32B Preview
Sky · second-state
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
ST
stable diffusion v 1 4
Stable · second-state
Params1.07B
Context—
Smallest1.6 GB
GGUF
TE
Tessa T1 3B
Tessa · second-state
Params3.09B
Context117K
Q4_K_M1.9 GB
Tool use
EX
EXAONE Deep 2.4B
Exaone · second-state
Params2.41B
Context32K
Q4_K_M1.5 GB
Coding
QW
Qwen2 0.5B
Qwen · second-state
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · second-state
Params20.9B
Context128K
Smallest12.1 GB
Tool use
DA
datagemma rig 27b it
Datagemma · second-state
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
XL
xLAM 1b Fc R
Xlam · second-state
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use

Keep browsing