GGUF models by second-state

291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
all-MiniLM-L6-v2
All · second-state
Params23M
Context512
Q4_K_M0.0 GB
Embedding
ST
stable diffusion v1 5
Stable · second-state
Params1.07B
Context—
Smallest1.6 GB
GGUF
ST
stable diffusion 3.5 large
Stable · second-state
Params695M
Context—
Smallest0.7 GB
GGUF
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
GGUF
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
GGUF
RE
Realistic Vision V6.0 B1
Realistic · second-state
Params1.07B
Context—
Smallest1.5 GB
GGUF
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
MI
E5 Mistral 7B Instruct Embedding
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
FL
FLUX.1 dev
Flux · second-state
Params123M
Context—
Smallest0.1 GB
GGUF
JI
jina embeddings v2 base code
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
DE
Deepseek Coder 6.7B Instruct
DeepSeek · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
WI
Wizard Vicuna 13B Uncensored
Wizard · second-state
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
PH
Phi 3 Mini 4k Instruct
Phi · second-state
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
CodeLlama 70b Instruct hf
Llama · second-state
Params69B
Context4K
Q4_K_M41.4 GB
Coding
ST
starcoder2-7b
StarCoder · second-state
Params7.17B
Context16K
Q4_K_M4.4 GB
Coding
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
ST
starcoder2-15b
StarCoder · second-state
Params16B
Context16K
Q4_K_M9.9 GB
Coding
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama 2 13B Chat
Llama · second-state
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FL
FLUX.1 Fill dev
Flux · second-state
Params11.9B
Context—
Smallest4.2 GB
GGUF
ST
starcoder2-3b
StarCoder · second-state
Params3.03B
Context16K
Q4_K_M1.8 GB
Coding
LL
Llava v1.6 Vicuna 7B
LLaVA · second-state
Params6.74B
Context4K
Q4_K_M4.1 GB
Vision
QW
Qwen2.5 VL 7B Instruct
Qwen · second-state
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · second-state
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
ELYZA japanese Llama 2 13b fast instruct
Llama · second-state
Params13.1B
Context4K
Q4_K_M8.0 GB
GGUF
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

About second-state on Hugging Face

second-state has published 291 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Mistral. The most downloaded are all-MiniLM-L6-v2, stable diffusion v1 5 and stable diffusion 3.5 large.

The quants second-state publishes most often are Q4_0 (288), Q5_0 (287), Q8_0 (285) and Q2_K (281). Their Q4_K_M files range from 0.0 to 142.5 GB. Parameter counts run from 23M to 236B, and the longest trained context window is 10240K tokens.

Frequently asked questions

What GGUF models has second-state published?

291 models are listed here, mainly from the Qwen, Llama and Mistral families. The most downloaded is all-MiniLM-L6-v2.

Which quants does second-state publish?

The most common are Q4_0 (288 models), Q5_0 (287 models), Q8_0 (285 models) and Q2_K (281 models).

Keep browsing