GGUF models by second-state

291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2 Math 1.5B Instruct
Qwen · second-state
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 30B A3B
Qwen · second-state
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
TE
Tessa T1 7B
Tessa · second-state
Params7.62B
Context117K
Q4_K_M4.7 GB
Tool use
MO
Moxin Chat
Moxin · second-state
Params8.11B
Context32K
Q4_K_M4.9 GB
GGUF
LL
r1 1776 distill llama 70b
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
BE
Bespoke Stratos 32B
Bespoke · second-state
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
XL
xLAM 8x7b R
Xlam · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
PH
Phi 4 Reasoning
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
SE
SeaLLMs Audio 7B Chat
Seallms · second-state
Params7.64B
Context8K
Q4_K_M4.7 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · second-state
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
PH
Phi 4 Mini Reasoning
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen2.5 14B Instruct 1M
Qwen · second-state
Params14.8B
Context986K
Q4_K_M9.0 GB
Tool use
MO
Moxin Reasoning 7b
Moxin · second-state
Params8.11B
Context32K
Q4_K_M4.9 GB
Reasoning
YI
Yi 6B Chat
Yi · second-state
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
OS
Osmosis Structure 0.6B
Osmosis · second-state
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
TE
Tessa T1 14B
Tessa · second-state
Params14.8B
Context117K
Q4_K_M9.0 GB
Tool use
XL
xLAM 7b Fc R
Xlam · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
GP
Gpt Oss 120b
gpt-oss · second-state
Params117B
Context128K
Smallest63.4 GB
Tool use
WA
waiANINSFWPONYXL v90
Waianinsfwponyxl · second-state
Params3.47B
Context—
Smallest2.0 GB
GGUF
TE
Tessa T1 32B
Tessa · second-state
Params32.8B
Context117K
Q4_K_M19.9 GB
Tool use
YI
Yi 34B 200K
Yi · second-state
Params34.4B
Context195K
Smallest12.8 GB
GGUF

Keep browsing