GGUF models by second-state
291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Llama 3.2 3B Instruct
Llama · second-state
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
Deepseek LLM 7B Chat
DeepSeek · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · second-state
Params409M
Context8K
Q4_K_M0.3 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · second-state
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3 1.7B
Qwen · second-state
Params2.03B
Context40K
Q4_K_M1.3 GB
GE
gemma-2-9b-it
Gemma · second-state
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · second-state
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
Medgemma 4b It
Medgemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2 VL 7B Instruct
Qwen · second-state
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · second-state
Params8B
Context8K
Q4_K_M4.9 GB
BI
Bielik 1.5B v3.0 Instruct
Bielik · second-state
Params1.6B
Context8K
Q4_K_M1.0 GB
QW
Qwen2 Audio 7B Instruct
Qwen · second-state
Params7.75B
Context8K
Q4_K_M4.8 GB
PH
Phi 3 medium 4k instruct
Phi · second-state
Params14B
Context4K
Q4_K_M8.6 GB
LL
Llama 3.2 1B Instruct
Llama · second-state
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
Bielik 4.5B v3.0 Instruct
Bielik · second-state
Params4.76B
Context8K
Q4_K_M2.9 GB
JI
jina embeddings v2 base de
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · second-state
Params1.64B
Context4K
Q4_K_M1.0 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
Seed Coder 8B Instruct
Seed · second-state
Params8.25B
Context32K
Q4_K_M5.1 GB
LL
Samantha 1.11 CodeLlama 34B
Llama · second-state
Params33.7B
Context2K
Q4_K_M20.2 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · second-state
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen1.5-1.8B-Chat
Qwen · second-state
Params1.84B
Context32K
Q4_K_M1.2 GB
QW
Qwen2.5 7B Instruct
Qwen · second-state
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · second-state
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 32B Instruct
Qwen · second-state
Params32.8B
Context32K
Q4_K_M19.9 GB