GGUF models by second-state
291 GGUF models quantized by second-state on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
GE
Gemma 3 27b It
Gemma · second-state
Params27B
Context128K
Q4_K_M16.5 GB
OR
Orca 2 13B
Orca · second-state
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
gemma-2-27b-it
Gemma · second-state
Params27.2B
Context8K
Q4_K_M16.6 GB
SM
SmolVLM2 256M Video Instruct
Smolvlm · second-state
Params163M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M Instruct
SmolLM · second-state
Params362M
Context2K
Q4_K_M0.3 GB
QW
Qwen2.5 14B Instruct
Qwen · second-state
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · second-state
Params14.8B
Context32K
Q4_K_M9.0 GB
PH
Phi 4 Mini Instruct
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwen1.5-4B-Chat
Qwen · second-state
Params3.95B
Context32K
Q4_K_M2.5 GB
IN
Internlm2_5 7b Chat 1m
InternLM · second-state
Params7.74B
Context256K
Q4_K_M4.7 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · second-state
Params7.82B
Context4K
Q4_K_M4.8 GB
LL
Meta Llama 3.1 8B
Llama · second-state
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 72B Instruct
Qwen · second-state
Params72.7B
Context32K
Q4_K_M47.4 GB
PH
Phi 3.5 Mini Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
JI
Jina Embeddings v3
Jina · second-state
Params558M
Context8K
Q4_K_M0.4 GB
GL
glm-4-9b-chat
GLM · second-state
Params9.4B
Context128K
Q4_K_M6.3 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · second-state
Params8.89B
Context1024K
Q4_K_M6.5 GB
DA
3dAnimationDiffusion v10
Danimation · second-state
Params1.07B
Context—
Smallest0.2 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · second-state
Params8.19B
Context128K
Q4_K_M5.0 GB
SE
Seed OSS 36B Instruct
Seed · second-state
Params36.2B
Context512K
Q4_K_M21.8 GB
GE
Gemma 2 2b It
Gemma · second-state
Params2.61B
Context8K
Q4_K_M1.7 GB
NE
Neural Chat 7B v3 3
Neural · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Seed Coder 8B Reasoning
Seed · second-state
Params8.25B
Context64K
Q4_K_M5.1 GB
LL
Meta Llama 3.1 70B Instruct
Llama · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · second-state
Params32.8B
Context128K
Q4_K_M19.9 GB
CO
c4ai-command-r-v01
Command R · second-state
Params35B
Context128K
Q4_K_M21.5 GB
ST
Starling LM 7B alpha
Starling · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
WI
WizardLM 13B V1.0 Uncensored
Wizardlm · second-state
Params13B
Context2K
Q4_K_M7.9 GB